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EXECUTIVE SUMMARY 

INTRODUCTION 

Acting under the FY86-90 Defense Guidance (DG), the Deputy Chief of 
Naval Operations (DCNO) for Manpower, Personnel, and Training (MPT) 
initiated a program to assess technical skills of Navy Individual Ready 
Reservists (IRR). Participation of the Naval Training Systems Center 
(NAVTRASYSCEN) was requested. Specifically, NAVTRASYSCEN iCode 10) was 
requested to study and analyze the deterioration of Navy skills acquired on 
active duty during time spent in the IRR. In accordance with the DG, 
analysis of skill deterioration was to determine retraining needs of the 
Navy IRR to maintain the minimum proficiency required to support 
mobilization. 

APPROACH 

Skill deterioration and retraining needs were assessed for 16 critical 
ratings (see appendix A). These were considered critical based on the 
criterion of projected personnel shortfalls for mobilization. 
Questionnaires were used to obtain job performance information (tasks 
performed and proficiency associated with their performance). Data were 
obtained from both IRR personnel and from E-4s currently on active duty in 
the ratings. Proficiency was defined in terms of the degree of supervision 
needed to perform job tasks. Information concerning current civilian 
employment was also obtained from the IRRs. 

IRR respondents estimated their proficiency on rating job tasks at 
their End of Active Obligated Service (EAOS) and at the present time (NOW). 
Differences between EAOS proficiency and NOW proficiency provided the 
measures of skill deterioration. Active duty personnel working at the E-4 
level of their rating estimated their current proficiency on rating job 
tasks. The E-4 level was selected to provide a working definition for the 
DG concept of "minimum proficiency to support mobilization." Thus, differ- 
ences between the current proficiency level of the active duty E-4s and the 
IRR rating groups provided the basis for determining if training was needed 
to bring the IRRs to an acceptable proficiency level before mobilization. 

Specific findings about skill deterioration and IRR retraining needs, 
for the 16 individual ratings studied, are presented in 16 annexes to 
appendix D of this report. The annexes identify IRR refresher and 
maintenance training likely to be needed to support mobilization, and the 
specific job tasks of each rating that training should emphasize. Skill 
upgrade training needs are also discussed for each rating. General findings 
and conclusions that pertain to the overall group of ratings studied are 
presented below. 

FINDINGS AND CONCLUSIONS 

General findings and conclusions are given for three areas: Data base, 
skill deterioration, and IRR training needs. 
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Data Base 

Several study findings indicated that the Navy IRR data files may be 
incomplete or inaccurate in a number of areas. These deficiencies can lead 
to incorrect estimates of the IRR manpower that can be mobilized. Problems 
apparently exist in both file content areas and in the procedures used to 
maintain currency of the files. Specific findings supporting this conclu- 
sion were: 

Approximately 30 percent of the mailing addresses listed for IRRs 
in the six Cryptologic Technician (CT) ratings were incorrect 
(range 28 to 40 percent). 

Approximately 10 percent of the addresses for the other 10 
ratings were incorrect (range 6 to 15 percent). 

Based on questionnaires returned, an estimated 5 percent of IRRs 
who did not return questionnaires may not be in the viable man- 
power pool because they have, for example, reenlisted, passed 
their 60th birthday, received final discharges, died. 

In a number of ratings (notably the CT group), far fewer names of 
IRRs completing Military Service Obligations (MSO) were listed 
than would be expected considering service separation rates. 

Many IRRs (61 percent) in the ratings studied had already com- 
pleted their MSO of 2 years. If individual agreements with these 
personnel are not on file, they are beyond the zone of 
involuntary recall for mobilization. 

"Last Release from Active Duty 11 information needed to purge files 
and issue discharges was not contained in the IRR data files for 
approximately 7 percent of the Barnes in the samples drawn. 

Skill Deterioration 

As measured oy differences in proficiency reported for EAOS and 
current proficiency, skills acquired on active duty do deteriorate during 
IRR membership. Considerably less deterioration occurred for those IRRs 
who, after EAOS, worked in civilian jobs related to their Navy ratings. 
The skill deterioration that occurs does not appear to be a major, general 
problem insofar as dictating needs for comprehensive retraining of IRRs to 
support mobilization. For most of the ratings, the current proficiency 
levels of IRRs compared favorably with the proficiency levels reported by 
individuals who are currently on active duty. Thus, the typical IRR should 
be able to perform most job tasks of his rating at mobilization after brief 
familiarization such as would be provided by direct, corrective super- 
vision. However, skill deterioration effects were sufficient in five 
ratings to indicate some formal IRR retraining needs. 
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IRR Training Needs 

Retraining needs for IRRs in two ratings could not be determined 
because of small sample sizes* Formal retraining and maintenance training 
for all IRRs in three ratings and for those IRRs in two other ratings who 
are noF currently working in civilian jobs related to their rating may be 
necessary to support mobilization. A specialized curriculum emphasizing 
selected rating job tasks appears desirable. Skill upgrade training should 
be considered for all IRR personnel who have been off active duty for 
greater than 3 years because of prooable changes to equipment, procedures, 
and materials used in job performance. For all other IRRs in the ratings 
studied, retraining and maintenance training prior to mobilization appear 
to be unnecessary. Famil iarization training at recall consisting of 
supervised practice may suffice. 
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SECTION I 
INTRODUCTION 

BACKGROUND 

Following a first tour of active duty, Naval personnel who do not elect 
other service options are assigned to the Individual Ready Reserve (IRR) to 
complete a Military Service Obligation (MSO). Other former service person- 
nel may enlist in this Reserve. By its nature, the IRR constitutes a pool 
of trained manpower. It is a principal mobilization asset, and all within 
the IRR may be involuntarily recalled to active duty in the event of 
national emergency. 

IRR members, typically, do not drill. Thus, they receive no deliberate 
practice on the skills they acquired while on active duty. Thus, a concern 
of mobilization planners is that these previously-acquired skills may 
deteriorate during IRR membership to the point where a reservist could not 
make an effective contribution to a receiving unit's mission. 

In recognition of the skill loss problem, the fiscal year (FY) 86-90 
Defense Guidance (DG) required the military services to develop and program 
refresher training as necessary to maintain the minimum IRR proficiency to 
support mobilization. Accomplishment of the DG tasking called for a deter- 
mination of IRR skill proficiency degradation and refresher training for 
skills considered most critically needed for mobilization. Subsequent to 
issuance of the DG, the Deputy Chief of Naval Operations (DCNO) for Man- 
power, Personnel, and Training (0P-01R1), requested the Naval Training 
Systems Center (NAVTRASYSCEN) study and analyze the degradation of skills 
attained by Navy IRR personnel while on active duty. 1 

PURPOSE 

The purpose of the study was to assess the deterioration of critical 
Navy skills during the time individuals are assigned to the IRR. The need 
for training to maintain skills and/or to restore or upgrade skills to mini- 
mum proficiency to support mobilization was also to be determined. Implicit 
in the tasking was the additional requirement to define minimum, or 
acceptable, proficiency. Of most interest to CNO were individual ready 
reservists separated from active service less than 3 years. 

ORGANIZATION OF THE REPORT 

The remainder of this report is presented in five sections and four 
appendices. Section II presents the technical approach to the study. Over- 
all results concerning the evidence for skill deterioration and needs for 
retraining are given in section III. These results are general and appiy 
across all 16 ratings studied. A discussion of these results and 
interpretations possible from the data are provided in section IV. Section 
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V presents study conclusions. Recommendations concerning training for IRR 
members to support mobilization are given in section VI. 

Appendix A provides brief descriptions of the jobs performed in each of 
the 16 ratings studied. Appendix B identifies activities visited for infor- 
mation needed for the study. Copies of the various cover letters used to 
transmit questionnaires are provided in appendix C. Appendix 0 contains 16 
annexes. Each annex is a stand-alone document that treats one particular 
rating (e.g., Hospital Corpsman, Electricians Mate). The annexes d 8 iden- 
tically formatted. Each contains a brief introduction and a succinct 
description of the study approach. Results particular to the given rating 
are presented. The results are discussed and conclusions concerning skill 
deterioration and training needs for the rating are provided. Recommen- 
dations based on the conclusions are also presented. 
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SECTIOH II 



TECHNICAL APPROACH 



This section presents the technical approach to the study. A brief 
orientation is presented f i *st. This is followed by discussions of the 
procedural steps accomplisheo to conduct the study. 

STUDY ORIENTATION 

The orientation below provides definitions needed to guide the study 
effort and describes information needed to meet study objectives. 

Definitions 

The terms "critical skills" and "acceptable levels of proficiency" 
required definition at the outset of the study. Critical skills have pre- 
viously been defined in a number of ways; for example, as those skills that 
must be performed correctly, either to avoid hazards to personnel or equip- 
ment, or to assure effective mission performance. For this study, however, 
"critical skills" were defined by 0P-01R1 to mean critical "ratings" (i.e., 
Navy jobs). Critical ratings were further dafined as those ratings for 
which sufficient numbers of personnel were projected to be not available for 
mobilization. Sixteen ratings expected to have the most senous mobili- 
zation shortfalls were selected by OP-OiRl for the study: 



Aviation Electronics Technician (AT) 
Builder (By) 

Cryptologic; Technician (Administration) (CTA) 
Cryptologic; Technician (Interpretive) (CTI) 
Cryptologic Technician (Maintenance) (CTM) 
Cryptologic Technician (Communications) (CTO) 
Cryptologic Technician (Collection) (CTR) 
Cryptologic Technician (Technical) (CTT) 
Electrician's Mate (EM) 
Equipment Operator (EO) 
Electronics Technician (ET) 
Fire Control Tecnnician (Surface Missile) (FTM) 2 
Gas Turbine System Technician (Electrical) (GSE) 
Hospital Corpsman (HM) 
Operations Specialist (OS) 
Sonar Technician (Surface) (STG) 



Brief descriptions of the jobs performed by individuals in these ratings are 
presented in appendix A. 



tained throuqhout this report 



-All Fire Control Technicians are now subsumed under the designation of 
"FC." Since we examined only one FC subset, the FTM designation is main- 
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"Acceptable level of proficiency" was not as readily definable as 
critical skills. In a general sense, acceptable proficiency refers to the 
ability of a recalled ready reservist to make an effective contribution to a 
receiving unit's mission. In a more specific sense, it refers to ability to 
perform a defined set of job tasks at a defined level of competency. Such 
specific information was essential to the study, both to establish a base- 
line for assessing skill deterioration and to define the terminal goals 
(i.e., specific performances) that any proposed training regimen should 
attempt to achieve. This information was not readily available and consid- 
erable work was required to generate it. This effort is described in detail 
below under our description of the questionnaire development phase of the 
study. 

An additional early study requirement was to select a level or rate 
within each rating for which acceptable proficiency (job task and competency 
level) information would be developed. Different rates; i.e., pay grades, 
within a rating may perform different tasks. Alternately, they may perform 
the same tasks, but at different levels of competency. After consultation 
with 0P-O1R1, the E-4 level of each rating was chosen. This selection was 
based on the belief that IRR personnel in the majority of the ratings would 
have achieved this level prior to separation from active duty. Thus, the 
E-4 level provided a reasonable baseline for assessing skill deterioration. 
It was further believed that IRR personnel who could perform at the E-4 
level upon return to active duty under mobilization orders could make posi- 
tive and effective contributions to the missions of their receiving units. 
This belief was subsequently endorsed by Naval Education and Training Com- 
mand (NAVEDTRACOM) subject macter experts (SME) who provided initial job 
task and competency information for the study. 

Information Requirements 

Assessment of skill deterioration requires that measures of proficiency 
on job tasks be available at two different points in time. Conventionally, 
the first measure is taken at a point when proficiency is quite high, typi- 
cally at the end of some training regimen or when an individual (s) has been 
routinely performing job tasks. The second measurement is taken after a 
period of nonperformance of job tasks. The difference in measured profi- 
ciency reflects the amount of skill deterioration that has occurred over the 
elapsed time interval. 

In theory, a number of methods could have been used to obtain the 
required measures. Many of the more desirable methods could not be 
employed, however, for practical reasons. For example, there is a lack of 
readily available objective tests. Time and cost considerations precluded 
their development. Neither was it possible to assemble groups of IRR 
members at central locations for assessment by testing, interviewing, or 
other appropriate means. Consequently, the decision was made tc use mail* 
out questionnaires to obtain the required data. Skill deterioration would 
be represented by the difference between the IRR respondents 1 reported 
ability to perform required job tasks at the end of their active obligated 
service (EAOS) and their estimates of current (i.e., NOW) proficiency. 
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Information, comparable in form to that obtained from IRR personnel, 
was also needed from active duty E-4s. This would reflect the tasks that 
are performed on active duty and the competency/prof iciency with which they 
are performed. Thus, it, by definition, constitutes E-4 criterion perform- 
ance. Accordingly, IRR information could be compared to this baseline for 
assessing skill deterioration and, more importantly, training needs. Train- 
ing needs would be determined by the differences between the current profi- 
ciency of the IRR group and the current proficiency of active duty personnel 
now working in the same rating. 

The above discussion provides definitions that guided the study and 
describes information needed to meet the study objectives. The procedural 
steps followed are described and discussed below. These included conducting 
a brief literature review, developing data collection questionnaires, devel- 
oping necessary job task information, administering the questionnaires, and 
analyzing data. 

LITERATURE REVIEW 

Early in the program, a review of studies completed within the past 10 
years dealing with retention, skill maintenance, or retraining of military 
technical skills was accomplished. The review focused on studies that 
covered retention intervals of up to 3 years. This period corresponded to 
the time personnel of principal interest were assigned to the IRR. 

There was no intent to produce a scholarly resume of skill retention 
research. A number of recent, competent, comprehensive reviews of this 
literature are already available (e.g., Annett, 1977; Hagman & Rose, 1983; 
Hurlock 4 Montague, 1982; Schendel , Shields, & Katz, 1978). Information 
contained in these reviews was used to acquaint the project staff with 
current knowledge about skill retention/deterioration. This familiarity was 
desirable to permit interpretation of the IRR study findings against the 
background of current knowledge to determine if additions could be made to 
this knowledge through the collection and analysis of data, and to make 
readily available information that would be useful for subsequent recommen- 
dations for training to restore lost skills. 

Unfortunately, the vast majority of studies examined dealt with far 
shorter time intervals than are typical for IRR members. They were also 
concerned with issues that are not directly relevant to this IRR skill 
deterioration study. Most were concerned, for example, with studying 
retention as a function of: prior conditions such as differences in the 
amount of previous training, type of method used in training (e.g., frequent 
testing, lectures), task integration or task organization variables (e.g., 
how steps in a procedure relate to subsequent steps), nature of the material 
learned (e.g., knowledge versus skill tasks). 

The results of such studies have implications both for the prediction 
ot skill loss and for the design of training to minimize retention loss over 
time. These results should be appropriately considered in choosing alterna- 
tive methods to retrain lost skills, particularly if there is an interest in 
minimizing subsequent skill loss (i.e., after retraining has occurred). 
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However, the present study was concerned with assessing the amount, nature, 
and implications for retraining of skill deterioration. It was not directly 
concerned with the effects of manipulating training variables to influence 
skill losses. 

Two salient findings, however, emerged from the literature that do have 
relevance to the present study: 

1. Skill deterioration may be at a maximum after about 1 year of 
nonuse of the skill (e.g., Wick, Millard, Cross, Ruffner. Keenan, Everhart, 
& Bickley, 1984). This finding can affect recommendations for skill mainte- 
nance training. 

2. Relearning, to restore lost skills, requires about one-half of the 
time required to learn the skills initially (e.g., Annett, 1977; Naylor & 
Briggs, 1961). This finding has obvious implications for time and other 
resources required for retraining (or refresher) training. 

QUESTIONNAIRE DEVELOPMENT 

This subsection describes the work accomplished to develop question- 
naires for use with both IRR personnel and active duty personnel. 
Constraints placed on this development are presented first. Details of 
development of job task statements for questionnaire use are then given. 
Response options and background questions used on questionnaires are also 
discussed. 

Cons traints 

Constraints/qualifications placed (by the project staff) on the ques- 
tionnaires were that: 

1. Each should contain a sufficient number of concisely stated, tech- 
nically accurate job task statements to represent fairly the specific Navy 
job performed by E-4s in the given rating. 

?. Each questionnaire, to the extent compatabil ity with 1 above could 
be achieved, should be limited to one page. It was believed, based on 
inputs from local Navy recruiters, that this measure would enhance the 
return rate from a population (of IRR members) over which the Navy has no 
effective motivational controls. 

3. Response options selected for use on the questionnaires should be 
stated in terms familiar to Navy personnel and, accordingly, permit easy 
selection of alternatives. 

4. No classified information could be coiKained on any questionnaire. 
Job Task Information 

To determine if skill losses occurred during IRR membership, it was 
first necessary to determine what skills (tasks) these individuals performed 
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on active duty and how well they could or should have been able to perform 
them. Subject matter expert (SME) assistance was needed. For all ratings 
except HM, the required SME assistance was obtained from NAVEDTRACOM "A" 
Schools. Coordination was effected with the Chief of Naval Education and 
Training (CNET) and three functional commanders (Chief of Naval Technical 
Training; Commander, Training Command, U.S. Atlantic Fleet; Commander, 
Training Command, U.S. Pacific Fleet) to obtain this assistance. For the HM 
rating, SME assistance was obtained from the staff of the Navy Hospital at 
Orlando. Activities visited are identified in appendix B. 

The same procedure was used in all 16 cases to develop job task state- 
ments and to obtain proficiency level information. As a first step, 
complete Job Task Inventories (071) were obtained for all 16 ratings from 
the Navy Occupational Data Analysis Center (N00AC). Information detailing 
the percentages of individuals at each rating level (i.e., rate; e.g., E-4, 
E-5, E-6) performing the separate tasks was included. The Occupational 
Standards and Personnel Advancement Requirements (PAR) for each rating were 
also obtained. The Occupational Standards, derived from the 071 s, list 
typical (i.e., standard) job tasks performed by individuals in a rating. 
The PARs list job tasks on which individual proficiency must be demonstrated 
before he/she can be promoted to a given pay level (e.g., E-4) or rate 
(e.g., HM-3) within a rating. The JTIs, Occupational Standards, and PARs 
wer; the basic items used to develop job task statements. 

Sixteen activities, one per rating, were visited for SME assistance 
(appendix B). Prior to a visit to any particular site, the project staff 
prepared a preliminary list of job tasks for the rating in question. The 
top 50 percent, as determined by the percentage of E-4s performing, of tech- 
nical job tasks was extracted from the OTIs. These were compared to the 
Occupational Standards, and duplicate tasks were eliminated. The prelimi- 
nary list, the complete 0TI, the Occupational Standards and the PARs for 
each rating were taken to the field for use there. Because of the working 
convenience afforded by the proximity of the Naval Hospital at Orlando, HM 
job task information was developed first. The resulting prototype question- 
naire instrument was also taken to the other 15 activities as an example of 
the type and level of information desired. 

At each activity visited, a standard procedure was followed. After 
receiving a project briefing, SMEs, typically five at each activity, 
reviewed the preliminary E-4 job task list and the Occupational Standards. 
They were instructed to select those tasks that in their collective opinion 
best represented the job that they would want a reservist returning to 
active duty to be able to do. They were further instructed to, and did, 
eliminate tasks considered nonessential (e.g., administrative tasks) in a 
mobilization situation, combine tasks where it was reasonable to do so, 
eliminate duplications, and to improve task wording where desirable/ 
necessary for clarity or accuracy. 

The SMEs, continuing to work in committee, next reviewed the PAR task 
statements for the E-4 and E-5 levels of the rating, adding those they felt 
were appropriate and/or otherwise revising the list previously selected. 
SMEs next reviewed the complete JTIs for the rating in question, drew on 
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their own past experiences, reviewed the "A 11 School course outline and any 
other materials that they had brought to the meeting. In all instances, 
tasks considered essential for performance by an E-4 were added to the list. 
From this process, a master list of tasks, its principal basis being the 
rating E-4 PAR, was compiled. This list represented the E-4 job generally 
performed across a rating rather than a job specific to a given Navy 
enlisted classification NEC. Questionnaires designed for use with specific 
NECs were not desirable since it was known that too few IRR members with 
given NECs were available to justify use of NEC specific instruments. 

When the panel of SMEs was satisfied with the task list—these were the 
tasks they wanted a returning E-4 reservist to be able to perform— they were 
then asked to indicate the level of proficiency they felt the returning 
reservist should bring to the job. For this, the SMEs independently 
assigned a value to each task according to the following criteria: 

1. Cannot do without supervision. 

2. Can do with general supervision. 

3. Can do with occasional supervision. 
4 Cat. io without supervision. 

5. Can do extremely well without supervision. 

After making their independent ratings, the SMEs discussed each task 
and either did or did not change their assessments depending on their own 
convictions. Finally, the SMEs, following the same basic procedure, esti- 
mated the level of skill that an individual would be expected to have if ne 
had not performed a given task for 2 years. 

The purpose of obtaining these assessments was twofold. The first was 
to provide a preliminary, baseline estimate of the level of task proficiency 
that a returning IRR member should be able to exhibit on the fleet job. 
Thus, this information provided an interim set of goals that a retraining or 
skill maintenance training program should attempt to achieve. It was 
planned to obtain a more reliable estimate of task performance/task level 
proficiency by surveying active duty personnel. 

The second purpose was to obtain an initial estimate of the extent to 
which skill loss might be a problem; specifically, how skill deterioration 
in IRR members could be expected to affect ability to perform job tasks. It 
was also planned to compare these SME estimates to data collecced from the 
IRR. However, the IRR data would be considered more reliable because of the 
larger number of respondents involved. Because of the basic source 
materials used— principally the PARs-- and based on SME opinions, it was 
further tacitly assumed that the job tasks selected did, in fact, represent 
the job that IRR members performed while on active duty. This assumption is 
especially tenable for those separated for 3 years or less. Support for 
this assumption was also shown by analyses later conducted on IRR and active 
duty data (see section IV). 



30 

29 



Technical Report 86-007 



R esponse Options 

As mentioned previously, it was desired that the response options used 
on the questionnaires have meaning to present and former service personnel, 
be easy to understand, and permit ready selection from among alternatives. 
The options selected were known to meet these criteria based on the results 
of previous survey work conducted by the NAVTRASYSCEN (Hall, Denton, & 
Zajkowski, 1978). In addition to meeting the above criteria, the response 
options had to permit differentiation among individuals in terms of the 
level of skill they could apply/demonstrate on job tasks of a rating. In 
addition to the work cited above- SME opinions also supported that the 
options presented could adequately discriminate skill levels. 

The proficiency response options used on questionnaires were similar to 
those used by the SMEs. However, the number of options were reduced from 
five to four. Also, amplifying information was added to better explain a 
particular choice. A fifth option, "Have never performed the task," was 
also added. This would provide a basis for comparing .job tasks performed by 
IRR personnel with those performed by active duty personnel. This 
comparison was desired to determine if the active duty job currently is, in 
terms of requirements to perform particular tasks, the same job that IRR 
members previously performed. 

Figures 1 and 2 are copies of questionnaires used with HM IRR and 
active duty samples, respectively. Questionnaires used with the other 15 
ratings were identical in format. Job tasks assessed did, of course, differ 
by rating (see the annexes to appendix D of this report). 

Background Questions 

Questions designed to obtain information about experience or training 
related to an individual's Navy job was also contained on each question- 
naire. For the IRR group, information solicited concerned knowledge or 
experience gained after separation from active duty. It was hypothesized 
that individuals who had Navy job-related training or experience after EAOS, 
or who now worked in civilian jobs related to their former Navy jobs, would 
show less skill loss than those not similarly employed. The questionnaire 
for surveying active duty personnel asked if respondents were assigned sea 
or shore duty, and whether they currently worked in rating. 

STUDY SAMPLES 

Personnel samples employed in the study are described below. 
IRR Sagpjes 

Coordination with the Naval Reserve Personnel Center (NAVRESPERSCEN) 
(Code 70) at New Orleans, LA, was accomplished to obtain information about 
the IRR population. Subsequently, data files were obtained, via 
NAVRESPERSCEN, from the Naval Military Personnel Command (NAVMILPERSCOM) . 
These listed all IRR personnel in each of the 16 ratings. Information 
obtained included names, service numbers, and mailing addresses. IRR 
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If necessary, correct jw Service i 

ll toe work Mhlck you do MM related to jwur Navy 
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Yet lo 



Km you done PREVIOUS work Mhlck It related to y» 
Reey retina lloce your hplrotlen of Active AMmM 
Service (EAOS)f 

Ttt * 

Mere /m received tralnlne related to /Mir Ravy 
rati* since your Cnplrotlen of Active OoHpated 
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Ytt No 



ARSHER RCY: 



(1) Have never perfomnd tht task. 

(2) Cm/ciqU do I lop la porta of too totk (need 
direct lupervUloo). 

(3) Cm/com Id do mt torts of too t«k (nood 
fOttrol t u porv lsloo). 
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orders. urHe adnltllon ourftoo. notot). ROM.. (I) (2) (3) (4) (5) At eAOS..(l) (2) (3) (4) (S) 

14. AU.it, transfer, ond dlscnorto patients. ROM.. (I) (2) (3) (4) (5) At EAOS..(l) (2) (3) (4) (5) 

lb. rorfom preveetlve nalntonnnca on word end 

Clinical oouipnent. ROM.. (I) (2) (3) (4) (5) At EA0S..O) (2) (3) (4) (5) 

I/. Order and 00 Into In loot Hot. ROM.. (I) (2) (3) (4) (I) At eAO$..(l) (2) (3) (4) (5) 

Id* Measure vltel tlont (e.f.. tenperoture, restlro- 

tlon. olood presture). M0M..(1) it) (3) (4) (S) At CAOS..(l) (2) (3) (4) (5) 



Figure 1. Sample HM IRR questionnaire. 
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P«T 1: 



ANSMCft KCV: 



1. If oacettery, correct your Service hwnher. 

2. Ooot your current billot reeulre yew to work In j 
■evy ratine? 

Yet Mi 



3. what type duty It your cor *t billet? 

loo Shore__ 



(1) Have never performed tht task. 

(2) Can/could do tinpla pertt of tht task (need 
direct supervision). 

(3) Ct- could 0* attt pert! Of tHo task (need 
genorol l Oport ltlon). 

(4) Cm /cow 14 00 ill parts of tht Usk (need 
only occasional supervision. Meets 

■In Iwa lecal tpeed and accuracy t ta n to rdt.) 

(5) Can/could Oo coapleU task ewlckly and 
acwatnly (nood no supa rvlslon). 



mr 2: 



For ooth Joo took su 


tMt 


below: 






A. (Ho tht anew* 


r key 


above to Indicate yo 


ur QMIIIT iovoI of ability. 




1. UtO tfeO 001*01 

the to utkt. 


r key 


above to Ottlwata JO 


or EVICTED level of ability ofttr f ye< 


in of £21 porforaiflf. 



Open to suction apparatus, 
handle fM " 

c out loot. 



■lolttor o*yeen, 
handle fit kettles fellouleo, fooorol safety p 



.(1) it) (3) (4) (S) EXPECTED.. (1) (2) (3) (4) (') 



DeeonttraU o bttlc iiudert tend Inn. of anatoay end 
ohysloleey Including too function of tody lyttoat 
004 special tense or font. 



rtrfora (actual or stew la ted) card lope tannery 
rotate Nation (CM). 



3. 

I. Transport patients with or without special equlp- 

5. Provide eaereency treatweut for cqwm injur let, 
asphyxia, hunorrhipa, shock, Mounts, hums, 
unctntc levsnett, hoot ttraha, exhaettlon, frost 
blto, tooertten foot, oyt irritation, aid 
hyperveetl lotion. 

6. Perform cithotor nation and provldt urinary 
cathotor corn. 

Uta basic aneraaceetlcol calculations to prtporc 
and dltpente co oa o nly used pharmaceuticals. 

Convort wtieMa and ooaturot to approxlnata 
equivalents between cooaonly used tyttoos. 



7. 

a. 
t. 

10. 

ii. 

12. 
13. 
14. 

1$. 
Id. 

17. 
II. 



Ex Minn food tervlco workers. 

Identify inmyn nation types, eethodt and record - 
ifhj precederet. 

Assart la Intravenous therapy aoulpoont and 
reoulaU flow. 

Col Ik t rout 1 no blood toapiet; porfora coop late 
blood count, urinalysis, and area stain. 

Prepare oinor tur|1ca1 packs; porfora t tori la and 
supination techniouet. 



rd tenia 1 strati on function* (a.a., 
routine reports, troMcrlbo nodical officer's 
ordort, write odaittion nurtlne nous). 

Adult, transfer, ami dltchornt patients. 

Perform preventive aelnteuenca on ward and 
clinical eeula 



Order and Maintain twppllet 

%asure vital tlent 
tlon, blood pressure 



%asurevlta1 slant jo.e., teapereture, resPlra- 



.(1) (2) (3) (4) (5) 
.(D (2) (3) (4) (S) 
.(1) (2) (3) (4) (S) 



MM..(1) (2) 

N0H..(1) (2) 

MM..(D (2) 

N0N..(1) (2) 
N0M..(1) (2) 

MM..(1) (2) 

ww..(l) (t) 

N0H..(1) (2) 

N0W..(1) (2) 

bt*..(l) [I) 
MM..(1) (2) 

«*..(!) (2) 
MM..(1) (2) 



(3) (4) (S) 

(3) (4) fS) 

(3) (4) (S) 

(3) (4) (S) 
(3) (a) (S) 

(3) (4) (S) 

(3) (4) (S) 

(3) (4) (S) 

(3) (4) (S) 

(3) (4) (S) 
(3) (4) (S) 

(i) (4) (S) 
(3) (a) (S) 



EIrtCTC0..(1) (2) (3) (4) (S) 
E*rXCTE0..(1) (2) (3) (4) (5) 
EXrWtO..(1) (2) (3) (4) (S) 



EXPECTEO. 

EXPECttO. 

EXP ECHO. 

EXPECTED. 
EXPECTED. 

EXPECTEO. 

EXPCCTEO. 

EXPECTED. 

EXPECTED. 

EXPECTED. 
EXPECTED. 

expected. 
Expected.. 



.(1) (2) (') (•) (S) 

.(1) (2) (3) (a) (S) 

.(1) (2) (3) (4) (S) 

.(1) (2) (3) (4) (S) 
.(1) (2) (3) (4) (S) 

.(1) (2) (3) (4) (S) 

.(1) (2) (3) (4) (S) 

.(1) (2) (3) (4) (S) 

.(1) (2) (3) (4) (S) 

.(1) (2) (3) (4) (S) 
.(1) (2) (3) (•) (S) 

.(1) (2) (3) (4) (S) 
.(1) (2) (3) (4) (S) 



«M..(1) (2) (3) (4) (S) EXPECTEO.. (1) (2) (3) (a) (S) 



Figure 2. Sample HM active duty questionnaire. 
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rosters for the CT ratings were dated 10 December 1984. Listings for the 
other 10 ratings were dated 25 September 1984. 

Table 1 lists, by rating, the numbers of IRR personnel that held each 
rating and the numbers selected to receive questionnaires. Mailing dates 
are also shown. The decision was made to survey all members of a rating if 
ther* were 500 or fewer members. A low questionnaire return rate was 
expected and this population sampling strategy would result in the return of 
as many questionnaires as possible. Unfortunately, deviations from this 
practice occurred for five ratings (BU, £0, CTA, CTI, CTM) because of errors 
which misidentified the population sizes. For ratings having more than 500 
members, random samples of 500 each were drawn. 



Table 1 



IRR Questionnaire Mail-out Data 





Total 


Number 


Percent 








Number 






No. of 


Initially 


of 


Date 




Follow-ups 


Date 


Rating 


Records 


Mailed 


Total 


Mailed 


Mailed 


Mailed 


HM 


1,935 


500 


26 


22 


Oct 


84 


320 


29 Jan 85 


STG 


341 


341 


100 


22 


Oct 


84 


246 


29 Jan 85 


OS 


1,117 


500 


45 


30 


Oct 


84 


365 


29 Jan 85 


BU 


459 


350 


76 


31 


Oct 


84 


236 


29 Jan 85 


EO 


459 


370 


81 


31 


Oct 


84 


256 


29 Jan 85 


AT 


1,025 


500 


49 


21 


Nov 


84 


340 


29 Jan 85 


EM 


1,190 


500 


42 


21 


Nov 


84 


351 


29 Jan 85 


ET 


519 


519 


100 


21 


Nov 


84 


332 


29 Jan 85 


FTM 


219 


219 


100 


31 


Dec 


84 


168 


29 Jan 85 


GSE 


16 


16 


100 


31 


Dec 


84 


11 


29 Jan 85 


CTA 


328 


222 


68 


8 


Feb 


85 


136 


8 Apr 85 


CTI 


484 


367 


76 


8 


Fet 


85 


233 


8 Apr 85 


CTO 


820 


500 


61 


21 


Feb 


85 


336 


8 Apr 85 


CTR 


865 


500 


58 


21 


Feb 


85 


309 


8 Apr 85 


CTM 


170 


77 


45 


22 


Feb 


85 


62 


8 Apr 85 


CTT 


657 


499 


76 


22 


Feb 


85 


342 


8 Apr 85 


TOTAL 


10,604 


5,980 


56 








4,043 





Active Duty Samples 

Record data on all E-4s on active duty in each of the 16 ratings were 
obtained directly from the NAVMILPERSCOM. Random samples of personnel in 
each rating were selected to receive questionnaires. Sample sizes for each 
rating were based on the total population size, expected return rate (90 
percent), and confidence level desired (95 percent). This samplin^ strategy 
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is described in Krejcie and Morgan (1970). The sample sizes (number mailed) 
and population sizes are shown in table 2. Personnel listings were current 
as of 2 August 1985. 



Table 2 



Active Duty Questionnaire Mail -out Data 



Total No. Number Percent 

Rating of Records Mailed of Total 



AT 


2,634 


427 


16 


BU 


546 


292 


53 


CTA 


191 


159 


83 


CTI 


181 


155 


86 


CTM 


792 


321 


41 


CTO 


515 


279 


54 


CTR 


422 


271 


64 


CTT 


364 


271 


74 


EM 


4,692 


449 


10 


EO 


443 


271 


61 


ET 


6 893 


455 


7 


FTM 


1,308 


378 


29 


GSE 


338 


222 


66 


HM 


6,022 


456 


8 


OS 


2,668 


427 


16 


ST6 


1,531 


400 


26 


TOTAL 


29,540 


5,233 


18 



QUESTIONNAIRE ADMINISTRATION 



Reserve Group 

Mailing information for the IRR group is shown in table 1. All initial 
mailings were made under a CNO (OP-11) cover letter. Because of anticipated 
low return rates, follow-up mailings were planned and subsequently 
accomplished as shown in table 1. Duplicate questionnaires were mailed 
under a cover letter signed by the Commanding Officer, Naval Training 
Systems Center. Copies of the IRR questionnaire transmittal letters are 
provided in appendix C. 



9 

ERIC 



Active Duty Group 

Coordination was effected with the Commander in Chief, U.S. Pacific 
Fleet; Commander in Chief, U.S. Atlantic Fleet; and the Commander, Naval 
Security Group; to obtain authorization to survey active duty personnel. 
Appropriate coordination within CNO (OP-01) for approval of the survey 
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was also accomplished and a Report Control Symbol (RCS) was a;signed to the 
questionnaires. All active duty questionnaires were mailed on 18 September 
1985. These were mailed to 5,233 individuals assigned to approximately 
1,200 Naval activities, as identified by distinct Unit Identification Codes 
(UIC). All questionnaires to a given UIC were mailed in a single package 
addressed to the activity/unit commanding officer/officer in charge under a 
CNO (OP-01) cover letter. The cover letter explained the purpose of the 
survey, requested support for a high return rate, and reported the RCS 
assigned to the survey. A separate CNO cover letter soliciting cooperation 
was attached to each respondent's questionnaire. No follow-up mailing was 
planned since a fairly high return rate was expected from the active duty 
personnel. Copies of active duty questionnaire transmittal letters are con- 
tained in appendix C. 

DATA ANALYSIS 

Questionnaire returns were accepted until 28 February 1985 from the 
IRRs in the 10 non-CT ratings and until 24 Nay 1985 from the CT IRRs. Ques- 
tionnaires were accepted from active duty personnel until 31 December 1985. 

Returned questionnaires were scanned to determine their usability for 
the project. Those usable were sorted into the 16 rating categories sepa- 
rately for the IRR and active duty groups. Data were entered into computer 
files. Questionnaires returned by the Postal Service and those not usable 
for other reasons were maintained separately. 

Statistical treatment of the data consisted principally of reducing 
them to summary measures (i.e., means) and determining relationships among 
data. Analyses concerned with determining relationships between IRR and 
active duty data, and those concerned with assessing the need for anjr type 
of training for a rating used means computed over all responses (i.e., 1727 
3, 4, and 5) possible from an answer key (see figure 1 or 2). Analyses 
concerned directly with assessing skill deterioration used means computed 
from choices of only 2, 3, 4, or 5. These responses place proficiency and, 
consequently, deterioration along a continuum. 

The data were organized, tracked, and statistically analyzed using a 
WANG VS100 minicomputer. To prepare for the survey of the IRRs, a tape 
extract of the Enlisted Master File (EMF) for the 16 ratings was obtained 
through NAVRESPERSCEN. This tape was used to create the data base for the 
Reserve survey. A separate data file was created for each rating to contain 
demographics as well as data from the returned questionnaires. Only those 
records were selected that had a Branch and Class of Service (BRCL) code of 
H 32 M indicating U.S. Naval Reserve (Ready). 

In the cases where a sample was generated, those records with a 
Pretrained Individual Manpower Management System (PIMMS) indicator code of 
M 4 M were selected first* Since these reservists are under positive manage- 
ment by the NAVRESPERSCEN, it was hoped that they would produce fewer bad 
addresses and a higher response rate. The computer then generated a random 
sample from the remaining records to complete each file. (See table 1 for 
the number of questionnaires mailed.) 



ERIC 
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To establish a baseline for job competency, a tape extract, containing 
required demographic and service data on all active duty E-4 personnel in 
the 16 critical ratings, was obtained from the NAVMILPERSCOM. A data base 
was established for the active duty survey, similar to that of the IRR 
survey. Table 2 identifies the number of questionnaires mailed for the 
active duty survey. 

After the questionnaire responses were entered into the computer, an 
on-line software package— the SCSS Conversational System— written by SPSS, 
Incorporated, was used to perform the required statistical functions. 
Univariate analyses were run on each file to obtain descriptive statistics 
and frequency distributions. Means and standard deviations were computed 
for each task listed on a rating questionnaire. 

For IRRs, task means were computed both for the present level of skill 
(NOW) and for the EAOS levels. Skill degradation was derived by subtracting 
the mean value reported for each task at EAOS from the mean value reported 
for that task at the present time (NOW). The IRR data were further reduced 
into two subgroups to compare proficiency/deterioration differences between 
those who were not presently working in a job related to their Navy rating, 
and those who were. 

For the active duty group, task means were computed for current profi- 
ciency and "expected" proficiency for those currently assigned duty in their 
rating, and for those who were not currently working in their rating. Task 
mean proficiency values for the active duty E-4s (current proficiency, 
working in the rating) were used as a criterion for assessing IRR needs for 
premobilization training. 

The Zenith 120, using the Microstat software package, was employed for 
several other statistical procedures. Rank order correlations were run 
between EAOS responses for IRR members and NOW (current) responses of active 
duty members of each rating. Pearson Product Moment correlations comparing 
the Reserve EAOS responses with the active duty NOW responses were also 
obtained for each rating. Also, t tests were run on data from subgroups to 
assess response equivalence at EA0"S and at the current time. 
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SECTION III 
RESULTS 

This section presents summaries of data pertinent to the assessment of 
skill deterioration and determination of IRR training needs. The summaries 
concern all 16 ratings studied* Results applicable to the Individual 
ratings are presented in the 16 annexes to appendix D of this report. 

QUESTIONNAIRE RETURN STATISTICS 

Table 3 shows questionnaire return statistics for all 16 ratings 
assessed. The table presents, by rating, first, the number of question- 
naires mailed and the number and percent of nonvalid returns (nonvalid prin- 
cipally because of data base errors). The nonvalid category was composed 
mostly of questionnaires that could not be delivered by the Postal Service 
because of Incorrect mailing addresses. The number of questionnaires that 
were, presumably, delivered to addressees is shown next* Information con- 
cerning usable returns is given in the final column. Percent usable returns 
was computed over the "number delivered 11 base (e.g., for CTTs, 93 usable 
returns came from the 361 delivered for a usable return rate of 27.1 
percent)* 

Table 3 

Questionnaire Return Statistics: IRR 



Nonvalid Usable 

Number ^turns Number Returns 

Rat i ng Mai 1 ed No * Percent Del i vered No . Percent 



AT 


500 


46 


9.2 


454 


212 


46.7 


BU 


350 


54 


15.4 


296 


126 


42.6 


CTA 


222 


71 


32.0 


151 


50 


33.1 


CTI 


367 


118 


32.2 


249 


77 


30.9 


CTM 


77 


31 


40.3 


46 


11 


23.9 


CTO 


500 


127 


25.4 


373 


114 


30.6 


CTR 


500 


153 


30.6 


347 


91 


26.2 


CTT 


499 


138 


27.7 


361 


98 


27.1 


EM 


500 


35 


7.0 


465 


198 


42.6 


E0 


370 


43 


11.6 


327 


147 


45.0 


ET 


519 


52 


10.0 


467 


235 


50.3 


FTM 


219 


17 


7.8 


202 


73 


36.3. 


GSE 


16 


1 


6.3 


15 


10 


66.7 


HM 


500 


54 


10.8 


446 


214 


48.0 


OS 


500 


31 


6.2 


469 


185 


39.4 


STG 


341 


36 


10.6 


305 


124 


40.7 


TOTALS 


5,980 


1,007 


16.8 


4,973 


1,965 


39.5 
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Questionnaire return statistics for the active duty samples are shown 
in table 4. Since there were virtually no unusable returns, the percent 
usable was calculated simply by number returned/number mailed. 



Table 4 



Questionnaire Return Statistics: Active Duty 



Rati ng 


NUmDer Mai lea 


Number Returned 


Percent Usable 


AT 


427 


257 


60.2 


BU 


292 


163 


55.8 


CTA 

win 


159 


117 

XX/ 


71 fi 


CTI 


155 


79 


51.0 


CTM 


321 


216 


67.2 


CTO 


279 


184 


66.0 


CTR 


271 


177 


65.3 


CTT 


271 


158 


58.3 


EM 


449 


295 


65.7 


E0 


271 


143 


52.8 


ET 


455 


316 


69.5 


FTM 


378 


260 


68.8 


GSE 


222 


145 


65.3 


HM 


456 


285 


62.5 


OS 


427 


290 


67.9 


STG 


400 


268 


67.0 


TOTALS 


5,233 


3,353 


64.1 



BACKGROUND QUESTIONS 

Table 5 shows the number and percent of IRRs who reported that they now 
work in civilian jobs that are related to their Navy ratings. Related 
civilian employment ranged from a low of 7 percent for the OSs to a high of 
70 percent for the BUs. Other analyses, summarized later in this section, 
were performed to determine the effects of civilian related employment on 
skill deterioration and IRR training needs. Answers to the other two back- 
ground questions on the IRR questionnaire (see figure 1, part I, items 3 and 
4) concerning previous rating-related work and training are not reported. 
It was determined that these answers might be somewhat redundant and could 
not be unambiguously interpreted. 

Information concerning the current assignments of active duty personnel 
is provided in table 6. These data reflect the answers to questions 2 and 3 
of part I of the active duty questionnaires, a sample of which is shown in 
figure 2. These data are provided for information only. No secondary 
analyses were performed to determine the effects of these variables on 
reported proficiency. 
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Table 5 

Reservists Working in Civilian Jobs Related to Their Navy Ratings 



Rating 


Unr*l^ i nn 
nUl K 1 iiy 

Number 


in Do la tori Inh 

Percent 


Number Answering 


AT 


i in 


^? Q 






UJ 


7n ? 

/ u« c 


lei 


PTA 
u in 


11 

JL JL 


77 d 


AO 


PTT 

Ul 1 


ft 




/ 0 


CTM 


7 


63.6 


11 


CTO 


24 


21.4 


112 


CTR 


10 


11.0 


91 


CTT 


27 


28.7 


94 


EM 


104 


55.0 


189 


EO 


89 


61.8 


144 


ET 


138 


60.5 


228 


FTM 


38 


55.1 


69 


GSE 


3 


30.0 


10 


HM 


107 


50.7 


211 


OS 


12 


6.6 


181 


STG 


22 


18.2 


121 


TOTALS 


795 


41.5 


1,915 



TIME IN IRR 

As noted previously, the IRRs of most interest to the study were those 
separated from active duty for less than 3 years. Table 7 shows the numbers 
(and percent) of IRRs in each rating who fell into this category. Over all 
ratings studied, less than half of the IRRs had EA0S dates of less than 3 
years. Over the six CT ratings, only 12.2 percent fell into the under-3- 
year category. Note that table 7 entries apply only to the IRRs who 
returned questionnaires. No attempt was made to analyze the total data file 
that was available for the 16 ratings. 

An incidental finding of the study also concerned tht IRR file data. 
Date of "Last Release from Active Duty" (LRAD), which equates to EA0S for 
those completing their Military Service Obligation (MS0), was not contained 
on the records for a number of IRR personnel. Consequently, time between 
separation from active service and the questionnaire mailing date could not 
be determined. The number and percent of records in each rating sample for 
which this information was not available is shown in table 8. Over all the 
ratings, LRAD data were insufficient for 438 of 5,980 IRRs (7 percent). The 
two construction ratings (BU, E0) accounted for 43 percent of the insuffi- 
cient data. 
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Table 6 



Assignments of Active Duty Personnel 



Rating 




Assigned Sea Duty 




worKing in 


Oaf i no 

rsat i ng 


Number 


percent 


tiumDcr 
Mnswcr l ng 


Number 


Percent 


Number 
Answering 


AT 




38.9 


252 


coo 


Ql 7 
51 • / 




DM 

DU 


U 

3H 


34.4 


157 


1 Ad 

XHH 


Ql 1 

71 • 1 


1 Rft 


L 1M 


1 (\f 
XU'y 


93.8 


113 




Aft ft 


lid 
lit 


TTT 


Kn 


77 Q 


77 


1 o 




7ft 


CTM 


195 


92.0 


212 


202 


95.7 


211 


CTO 


149 


82.3 


181 


163 


90.0 


181 


CTO 


1 HQ 


91.9 


173 


X j5 


qh ft 


1 Ti 


CTT 


138 


88.5 


156 


147 


94.8 


155 


EM 


33 


11.3 


292 


274 


93.1 


294 


E0 


48 


34.3 


140 


120 


85.7 


140 


ET 


87 


27.8 


313 


290 


92.6 


313 


FTM 


9 


3.5 


256 


247 


96.8 


255 


GSE 


8 


55.9 


143 


128 


90.7 


141 


HM 


195 


69.1 


282 


246 


88.4 


278 


OS 


14 


4.9 


286 


266 


93.6 


284 


STG 


4 


1.5 


264 


251 


95.0 


264 


TOTALS 


1,357 


41.2 


3,297 


3,055 


92.7 


3,295 



TASK PERFORMANCE DATA 

Data summary tables giving detailed, complete task performance infor- 
mation for IRRs and active duty personnel are presented in the 16 annexes to 
appendix D. Only those analyses conducted to assess equivalency of data 
from the two sources are considered in this present section. 

Equivalency of data obtained from IRR and active duty personnel in each 
rating was assessed through correlations. Rank order correlations were used 
to compare the frequency of selection of "1" choices by IRR personnel and 
active duty personnel. A "1" choice indicated that a respondent hc/i never 
performed a given job task. Tasks were ranked from 1 to "n" on the basis of 
highest number (percentage) of M 1 M choices to lowest. A rank order corre- 
lation (see Siegel, 1956) was computed, for each rating, between the data 
for IRR EA0S answers and active duty NOW (current) responses. The resulting 
rank order correlations are shown in table 9. These correlations were sig- 
nificant for 15 of the 16 ratings. Thus, the percentage of Reserve person- 
nel who had not performed specific tasks during their earlier active duty 
tends, strongly for most ratings, to be the same as it 1s now for active 
duty personnel. Thus, the structure of the rating jobs, considering the 
need to perform specific tasks, 1s relatively unchanged since the IRRs left 
active duty. 
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Table 7 



IRR Member Time Sine. Separation from Active Duty 



Oaf i nn 

Kat i rig 


Less Than 


3 Years 


More Than 


3 Years 


Total N 


NUlHDcr 


percent 


Number 


Percent 


AT 


107 


58.8 


75 


41.2 


182 


BU 


31 


36.0 


55 


64.0 


86 


CTA 


6 


13.0 


40 


87.0 


46 


CTI 


10 


14.3 


60 


85.7 


70 


CTM 


1 


9.1 


10 


90.9 


11 


\* 1 U 


7 


0. / 


98 


93.3 


105 


CTR 


14 


17.5 


66 


82.5 


80 


CTT 


10 


12.3 


71 


87.7 


81 


EM 


115 


73.7 


41 


26.3 


156 


E0 


44 


36.1 


78 


63.9 


122 


ET 


80 


36.4 


140 


63.6 


220 


FTM 


38 


58.5 


27 


41.5 


65 


GSE 


9 


90.0 


1 


10.0 


10 


HM 


135 


64.9 


73 


35.1 


208 


OS 


125 


74.0 


44 


26.0 


169 


STG 


81 


73.3 


31 


27.7 


112 


TOTALS 


813 


47.2 


910 


52.8 


1,723 



To determine the relatMnships between the proficiency exhibited on the 
job tasks by IRRs during Jieir earlier active service and the proficiency 
currently exhibited by E-4s, Pearson Product Moment Correlations (see 
Guilford & Fruchter, 1973) were computed for each rating between job task 
means for IRR EA0S and active duty (NOW) values. These correlations are 
also shown in table 9. Again, the correlations are generally significant 
and also Indicate a high degree of correspondence. The IRR members when on 
active duty performed job tasks at competency levels equivalent to those of 
current job incumbents. 

SKILL DETERIORATION 

Detailed IRR skill deterioration information for each task of each 
rating is given in the annexes to aopendix D. These are provided as mean 
values computed for each job task separately. Summarized skill 
deterioration information is provided in table 10. The table airplays grand 
means, computed over all tasks and all respondents in a rating, for 
proficiency at EAOS and NOW. The numbers of cases on which the means are 
based are also shown. These single values reflect overall changes in 
performance reported by IRRs to have occurred between EAOS and the precent 
time (i.e., when they answered the questionnaires). The table shows that 
decreases in skill levels occurred across the job tasks for 14 of the 16 
ratings assessed during the time personnel were assigned to the IRR. 
However, BUs and EOs reported an overall average gain in proficiency. 
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Table 8 

Insufficient LRAD Data in Rating Samples 



Insufficient LRAD 



Kdti ng 




Number 


Percent 


AT 


500 


30 


6 


BU 


350 


86 


25 


CTA 


222 


31 


14 


CTI 


367 


15 


4 


CTM 


77 


11 


14 


CTO 


500 


10 


2 


CTR 


500 


22 


4 


CTT 


499 


14 


3 


EM 


500 


9 


2 


E0 


370 


102 


28 


ET 


5)9 


48 


9 


FTM 


219 


7 


3 


GSE 


16 


1 


6 


HM 


5C0 


22 


4 


OS 


500 


12 


2 


STG 


341 


18 


5 



Table 9 

Rank Order Correlations (Rho) and Pearson Correlations (r) Between 
IRR EAOS and Active Duty Task Performance Data 



Frequency of Performance Proficiency of Performance 
Rating Rho Significant r Significant 



AT 


.78 


Yes 


.91 


Yes 


BU 


.96 


Yes 


.96 


Yes 


CTA 


.90 


Yes 


.57 


No 


CTI 


.84 


Yes 


.82 


7e> 


CTM 


.54 


Yes 


.43 


No 


CTO 


.85 


Yes 


.96 


Yes 


CTR 


.72 


Yes 


.75 


Yes 


CTT 


.67 


Yes 


.80 


Yes 


EM 


.94 


Y«iS 


.96 


Yes 


EO 


.94 


Yes 


.97 


Yes 


ET 


.83 


Yes 


.65 


Yes 


FTM 


.89 


Yes 


.91 


Yes 


GSE 


,15 


No 


.12 


No 


HM 


.2? 


Yes 


.93 


Yes 


OS 


.56 


Yes 


.63 


Yes 


STG 


.81 


Yes 


.91 


Yes 
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Table 10 

Average IRR Proficiencies at EAOS and NOW 



• 





EAOS 




NOW 




Rating 


Proficiency 


n 


Proficiency 


n 


AT 


4.259 


177 


3.936 


182 


BU 


3.494 


82 


3.757 


87 


CTA 


4.374 


47 


3.618 


46 


CTI 


3.893 


70 


3.002 


70 


CTM 


4.210 


11 


3.979 


11 


CTO 


4.236 


102 


3.226 


105 


CTR 


3.450 


80 


2.691 


80 


CTT 


3.640 


80 


2.883 


81 


EM 


4.019 


156 


3.7/9 


156 


EO 


3.141 


108 


3.400 


122 


ET 


4.167 


219 


4.030 


220 


FTM 


4.073 


64 


3.683 


65 


GSE 


4.429 


10 


3.986 


10 


HM 


4.107 


207 


3.795 


207 


OS 


4.500 


169 


3.970 


169 


ST6 


4.279 


114 


3.623 


112 



Effects of Related Work Experience 

Several analyses were conducted to determine if skill deterioration was 
related to current civilian occupation. Table 5 above presented information 
concerning the numbers of IRRs who reported that they currently worked in a 
civilian job related to their Navy ratings. Table 11 presents summary 
information concerning the effects of this related civilian employment on 
skill deterioration. 

The table shows how task mean proficiency values changed between EAOS 
and NOW for two IRR subgroups— those now working in a job related to their 
Navy rating (W) and those not working in a rating-related job (N). The 
table shows, for example, that between EAOS and NOW, the "W" ATs reported 
proficiency gains (i.e., higher mean values) on 7 of the 18 job tasks 
assessed (39 percent), proficiency losses on 10 tasks (56 percent), and no 
change on 1 task (6 percent). The "N" ATs lost proficiency (i.e., had lower 
mean values) on all 18 tasks (100 percent). Other table entries should be 
read similarly. The table shows, overall, that IRRs working in rating- 
related jobs were more likely to gain proficiency on more job tasks than 
IRRs who did not work in rating -related jobs. 

Table 12 compares the two IRR subgroups on mean values assigned to job 
tasks for NOW proficiency. The table shows the number and percent of tasks 
for each rating for which IRRs in the "W" subgroups reported lower current 
(NOW) task mean values than the "N M subgroups. The table"lfibws, for 
example, that ATs working in rating-related civilian jobs reported a lower 
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mean value than the "N" subgroup for only 1 of the 18 job tasks. By 
extrapolation, the "N" subgroup had lower mean values (less proficiency) on 
the other 17 tasks. Alternately, the AT M W" subgroup reported higher 
absolute mean values for 17 of the 18 job tasks. Less current proficiency 
was associated with the "W H subgroup over the majority of job tasks for a 
rating for only three of the ratings (6SE, OS, and STG). Note also that 
these three ratings had relatively small percentages of IRR members working 
in rating-related civilian jobs (see table 5). 



Table 11 

Proficiency Changes Between EAOS and NOW for IRRs Working/Not Working 

in a Rating-Related Field 



Working in Field (W^ Not Working in Field (N) 







Percent 


Percent 


Percent 


Percent 


Percent 


Percent 




No. Of 


of Tasks 


of Tasks 


No 


of Tasks 


of Tasks 


No 


Rating 


Tasks 


Gained 


Lost 


Change* 


Gained 


Lost 


Change 


AT 


18 


39 


56 


6 




100 




BU 


30 


90 


7 


3 


37 


63 




CTA 


9 


22 


67 


11 




100 




CTI 


16 




100 






100 




CTM 


13 


31 


54 


15 




92 


8 


CTO 


13 




100 






100 




CTR 


11 


9 


82 


9 




100 




CTT 


23 


9 


91 






100 




EM . 


23 


48 


52 






100 




EO 


27 


100 






26 


67 


7 


ET 


20 


50 


50 






95 


5 


FTM 


23 


26 


74 






100 




GSE 


21 




81 


19 


5 


67 


29 


HM 


18 


22 


72 


6 




100 




OS 


20 




100 


m 




100 




STG 


16 




100 






100 





♦Percentages do not add to 100 because of rounding. 



The significance of the differences between task mean values for NOW 
proficiency for the two subgroups was assessed for all ratings using t tests 
for independent means (see Guilford & Fruchter, 1973). The results are 
shown in table 13. Differences between the subgroups on current proficiency 
were significant for 14 of the 16 ratings. Higher mean values were asso- 
ciated with the "W" subgroups of these ratings. 
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Table 12 



Tasks on Which IRRs Working in a Rating-Related Job Had Lower Task 
Means Than IRRs Not Working in a Rating-Related Job 





Tftf al Ma 
lOtdl 110* 


no . or Lower 




Kdt i ng 


or idSKS 


Tip!/ Ma «nr 

lastc neans 


Percent 


AT 


18 


1 


6 


BU 


30 


5 


17 


CTA 


9 


0 




CTI 


16 


7 


44 


CTM 


13 


0 




CTO 


13 


1 


8 


CTR 


11 


2 


18 


CTT 


23 


0 




EM 


23 


1 


4 


E0 


27 


2 


7 


ET 


20 


0 




FTM 


23 


1 


4 


GSE 


21 


16 


76 


HM 


18 


0 




OS 


20 


13 


65 


STG 


16 


10 


63 



Since the current proficiency differences could possibly be due to 
initial differences between subgroup proficiency at EA0S, a second set of t 
tests was run on the EA0S task mean values. These results are also shown in 
table 13. Differences at EA0S were not significant for 13 of the 16 
ratings. Thus, for these ratings, differences in current proficiency could 
not reasonably be attributed to initial differences between the two 
subgroups. The results of these analyses indicated that (in 13 cases) IRRs 
who after EA0S worked in jobs related to their Navy rating lost less skill 
(conversely, had higher proficiency) than IRRs who did not. 

Effects of Tiwe 

A subsidiary Interest of this study concerned the effects of time on 
performance levels. Answers were desired to questions such as, (1) "At what 
point In time does skill deterioration level off?" and (2) "When should 
retraining begin?" Respondents in each rating were sorted into time groups 
of 6 months each up to 3 years since EA0S. All those with EA0S dates 3 
years or longer before the questionnaires were mailed were lumped into a 
single category. Means were computed for each time interval group for each 
rating. Also, a grand mean was computed over all ratings for the separate 
time intervals. The resulting values are shown in table 14. The numbers of 
cases on which means are based are shown in parentheses. The data revealed 
no trends in performance levels over time. The values remained relatively 
constant over all time interval groups within ratings and for the grand 
means across ratings. 
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Table 13 

Results of t Tests Comparing Differences Between Task 
Means at EAOS and NOW for Two Subgroups of IRRs 



EAOS NOW 



Rating 


t 


Significant 


t 


Significant 


AT 


.34 


No 


3.66 


Yes 


BU 


1.16 


No 


2.97 


Yes 


CTA 


1.66 


No 


5.98 


Yes 


TTT 

U 1 1 


3 71 


Yes 


2.74 


Yes 


CTM 


-.98 


No" 


4.19 


Yes 


CTO 


.22 


No 


1.92 


Ws 


CTR 


1.20 


No 


3.11 


Yes 


CTT 


-.85 


No 


5.71 


Yes 


FM 


.50 


No 


2.50 


Yes 


EO 


.50 


No 


3.66 


Yes 


ET 


1.66 


No 


4.07 


Yes 


FTM 


1.30 


No 


4.18 


Yes 


GSE 


2.86 


Yes 


-1.66 


No 


HM 


.45 


No 


3.04 


Tes 


OS 


4.32 


Yes 


1.96 


Yes 


STG 


.95 


No 


.27 


No 



TRAINING NEEDS 

Data presented in the immediately preceding subsection pertained to 
skill deterioration during IRR membership* An additional line of analysis 
was needed to assess the implications of skill deterioration for 
training/retraining of IRR personnel prior to mobilization. These analyses 
compared IRR current proficiency (i.e., task mean values) to proficiency 
reported by active duty E-4 personnel* These comparisons, made on a task- 
by-task basis for each rating, are fully reported in the annexes to appendix 
D. Table 15 summarizes the results* 

Table 15 shows overall mean proficiency values for active duty E-4 
personnel currently assigned duty in a given rating* The values are means 
of the individual mean proficiency values assigned to all tasks within a 
given rating* It also shows overall means for the two IRR subgroups 
comprising a rating* Interpretation of the data shown is deferred to the 
next section of this report* Note, however, that all three sets of means 
are relatively close in values* Particularly close are the values assigned 
by active duty personnel and the IRR M U M subgroups* These summary measures 
indicate there is little need for IRR retraining, especially for the M W M 
subgroups. 
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Table 14 



Average Performance Values by Rating at Different Time 
Intervals Since Separation From Active Duty 



Time Interval (in months) 



Rating 


0-5 


6-11 


12- 


•17 


18-23 


24-35 


36+ 


Average 


AT 


3.79 


(28) 


3.82 


(20) 


3.85 


(39) 


4.09 


(6) 


4.21 


(141 
^ ah; 


a nn 




\ QA 


M P9 ^ 


BU 


i.45 


(23) 


3.80 


(4) 


4.30 


(2) 


3.70 


(1) 


3.83 


(11 


1 ftfi 
O . oo 




^ 7fi 




CTA 


3.22 


(3) 






3.22 


(1) 






4 22 


12) 


o • oo 


( ACi\ 


^ A9 


f aa\ 


CTI 


3.23 


(6) 






4.63 


(1) 






3 71 


CM 


9 09 




o nn 


1 70) 


CTM 










- 


- 






A fiQ 

H .Oil 


\ 1J 


o. yi 


f i n\ 
UQJ 




(11) 


CTO 


3.72 


(3) 






- 


- 






^ A7 


f A\ 


0 9n 


198) 


O 90 
S.Li 


1 1 nc \ 

(105) 


CTR 


1.97 


(7) 

V ' 1 






- 


- 










Z.71 


/ cc \ 
(66) 


2.68 


/ on \ 

(80) 


1 CTT 


J. LJ 








3.46 


(2) 






2,83 


(5) 


2.86 


(71) 


2.89 


(81) 


EM 


3.90 


(23) 


3.72 


(24) 


3.49 


(28) 


3.99 


(23) 


3.58 


(17) 


3.91 


(41) 


3.78 


(156) 


EO 


3.21 


(28) 


3.52 


(7) 


4.05 


(3) 


4.15 


(1) 


3.53 


(5) 


3.41 


(78) 


3.40 


(122) 


ET 


3.87 


(22) 


4.26 


(7) 


4.31 


(17) 


3.66 


(13) 


4.20 


(21) 


4.02 


(140) 


4.03 


(220) 


FTM 


4.05 


(9) 


3.17 


(4) 


3.66 


(7) 


4.17 


(6) 


3.79 


(12) 


3.49 


(27) 


3.63 


(65) 


GSE 


2.86 


(1) 


4.26 


(3) 


4.67 


(1) 


3.27 


(2) 


4.39 


(2) 


4.29 


(1) 


3.99 


(10) 


HM 


3.70 


(45) 


3.48 


(16) 


3.73 


(32) 


3.69 


(14) 


3.76 


(28) 


3.99 


(73) 


3.80 


(208) 


OS 


4.16 


(32) 


4.00 


(20) 


4.06 


(45) 


4.28 


(16) 


3.95 


(12) 


3.62 


(44) 


3.97 


(169) 


STG 


3.95 


(23) 


3.91 


(12) 


3.42 


(14) 


3.69 


(19) 


3.66 


(13) 


3.31 


(31) 


3.62 


(112) 



MEAN 3.69 3.79 3.84 3.90 3.79 3.53 3.65 

TOTAL n (256) (117) (192) (101) (147) (910) 



(1723) 



ERIC 



51 



47 



Technical Report 86-007 



Table 15 

Overall Performance Ratings for Active Duty Personnel and IRRs 
Working/Not Working in a Rating-Related Job 



IRR 



Rating 


Active uuty 


W 


It M H 

N 


AT 


4.39 


4.36 


3.91 


BU 


3.86 


4.13 


3.79 


CTA 


4.34 


4.56 


3.79 


CTI 


4.11 


3.80 


3.33 


CTM 


4.13 


4.38 


3.76 


CTO 


4.30 


3.88 


3.49 


CTR 


3.91 


4.02 


3.36 


CTT 


3.88 


3.89 


3.21 


EM 


4.17 


4.32 


4.06 


EO 


4.02 


4.18 


3.82 


ET 


4.41 


4.45 


3.99 


FTM 


4.37 


4.29 


3.75 


GSE 


4.08 


3.92 


4.21 


HM 


4.24 


4.32 


3.98 


OS 


4.58 


4.27 


4.07 


STG 


4.00 


3.87 


3.83 



Reference to the annexes of appendix D is encouraged for examination of 
the individual analyses conducted for each rating before reaching firm con- 
clusions about retraining. Summary data derived from those individual 
analyses are, however, given in table 16. The table shows the percentage of 
tasks for the 'VT and N N M IRR subgroups in each rating on which retraining 
prior to mobilisation is indicated by the analyses conducted. Note that 
these data apply to retraining or refresher training where the objective is 
to restore lost skills to some specified (minimum) level. They also apply 
to skill maintenance training in that once skills are restored to the mini- 
mum level, training should be given to keep the skills at that level. The 
data do not, however, apply to skill upgrade training. Skill upgrade 
training must be considered separately from training needed to offset or 
overcome the effects of skill deterioration. Skill upgrade training is a 
matter of providing training on job tasks that an individual could not 
previously perform. These requirements are discussed in the annexes. 
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Table 16 

Retraining Requirements Indicated for Rating Job Tasks 





Number of 


Percent Retraining 


Indicated 


Rating 


Job Tasks 


IRR "W" 


IRR "N" 


AT 




n 
u 


11 


BU 




n 
u 


3 


CTA 

v in 


Q 

y 


u 


0 


CTI 


16 


CO 


69 


CTM 


13 


0 


15 


CTO 


13 


38 


62 


CTR 


11 


27 


64 


CTT 


23 


9 


78 


EM 


23 


0 


4 


EO 


27 


0 


0 


ET 


20 


0 


0 


FTM 


23 


0 


30 


GSE 


21 


0 


0 


HM 


18 


0 


0 


OS 


20 


0 


5 


ST6 


16 


13 


0 
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SECTION IV 
DISCUSSION 

This section comments on the data presented in section in and provides 
brief discussions of the overall results of the study. The principal 
purpose of the discussions is to summarize knowledge gained about the IRRs 
Ihnnt Vni^V" r J- ingS J st " di ? d : " is cauti °ned that firm conclusions 

52i2iJ ho e K n °? tl0n trai 1 ning " eeded t0 su PP° rt ™bilization should 
ultimately be based on data relevant to the individual ratings. Data 

2I5U 1C #«° tod individual ratings, and interpretations concerning training 

S DD pn2i/°nni RR t S hic in th °, Se r i tingS ' are contain ^ in the 16 annexes to 
appendix D of this report. These annexes should be consulted before firm 

2Si S10n T S , concerni "9 the specific actions needed prior to mobilization are 
k !' J- 11 c °T en ^ s and discussions presented below concern the IRR data 
base, skill deterioration, and training of IRRs needed to support mobili- 

SiiStiM *l! e 16 .: a 5 in 9 s studied. Finally, suggestions concerning data 
validation are provided. 3 

COMMENTS ON DATA BASE 

These^iJiteTOw. deficienci « were revealed by the study. 

a < "nSfjM^^ii^f 6 " 0 ?? 1 °! S 1 Questionnaires returned were classified 
as nonvalid" table 3). Almost 30 percent of the questionnaire returns for 

SIM !2 i -1 0r l ? e remainin 9 10 ratings, only 9.7 percent were non- 
ll a ? e .u non n val J d , "tegory included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (incorrect addresses) Pre- 
sumably, mobilization orders would also be undeliverable. rc55e5 >- Kr e 

The nonvalid category also included a small number of questionnaires 
returned with comments such as: "No longer in IRR, returned to active duty, 
already received final discharge. Retiree recruited from another service 
was never on active duty in the Navy." Finally, a very few Questionnaires 
were returned by individuals who refused to provide information and soml 

J? t'hl 411 "-? Jf rk ?^ " Deceased -" These factors affect estimates of the s?ze 
of the available IRR manpower pool. 

All information concerning "nonvalid" returns was transmitted to the 
Naval Reserve Personnel Center on 26 September 1985 for their use In deter- 
mining a n-.ed to validate the IRR data base. 

Questionnaires were presumably delivered by the Postal Service to a 

r f„ r f«°JLJ - RS 1n the 16 - ra „ tingS (60 - 5 percent) from whom («d about whom) 
no information was received. it is likely that many did not respond 

was C ToVa? D lic e a bl 0 ; S T< Vk th0Se cited above ' ^ey felt the questionnaire 
u a Lrn,hi P o P V e ;-i A ^ rther group ' of unknown size . then would also be 
^s ai Ju a r b re e nt f ly r ™ " 0t in the viable IRR -«P«-r pool 
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Another data base issue that arose concerns the amount of time that 
respondents have been away from active duty. This information is given in 
table 7. Only 47 percent were in the IRR for 3 years or less. The small 
percentages for the CT ratings are especially noticeable. Two issues emerge 
from time considerations: (1) the need for skill upgrading and (2) availa- 
bility for recall of IRR members. 

Skill upgrade training because of new equipment, procedures, or 
material may not be required for the less-than-3-years-since-EA0S group. It 
probably should be considered for the remaining 53 percent, however, despite 
their beliefs in their continuing ability to perform job tasks at an 
acceptable level (table 7). SMEs should make this determination based on 
changes to how the job is now performed. 

The second consideration concerns the MSO. At the time this study was 
initiated, the MSO was 6 years. (The MSO has since been increased to 8 
years.) Sixty-one percent of the group had been in the IRR more than 2 
years. Unless these reservists continued in the IRR under individual agree- 
ments, they were beyond the zone of involuntary recall to active duty. 
Therefore, the actual size of the available IRR manpower pool may be over- 
estimated. A different type of MSO-related problem was shown for several 
ratings, most notably the CT ratings. In this case, very few names were 
listed in the under-2-years-since-EA0S category; the names of individuals 
who should have been completing their MSO were conspicuously absent. 

An incidental finding also concerned the IRR file data. Date of "Last 
Release from Active Duty," which for first-tour service members indicates 
11 End of Active Obligated Service, " was not contained on 7 percent of the IRR 
personnel records. Without LRAD Information, purging the files when the MSO 
expires could be a problem. 

Based on the factors discussed above, complete examination of the IRR 
data file is recommended. The accuracy of the data and the existence of 
recall agreements should be verified. Procedures used to maintain the data 
files (data input, file update) should also be reviewed and corrected as 
necessary. 

SKILL DETERIORATION 

Summary information directly pertinent to skill deterioration was pre- 
sented in table 10. These data showed that deterioration occurred for all 
ratings except BUs and EOs who, rather than losing proficiency, actually 
gained some proficiency in the time since EAOS. The task-level data 
presented in the annexes to appendix D also showed that skill deterioration 
occurs during IRR membership, and, further, that the amount of this deteri- 
oration is related to an IRR's work experience after separation from active 
service. 

Computed over all 16 ratings, approximately 42 percent of IRRs reported 
that they currently worked 1n civilian occupations related to their Navy 
ratings. The actual percentages, of course, vary by rating and probably 
reflect the availability of civilian employment in particular technical 
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fields. Table 11 shows that for 15 ratings IRRs who work in civilian jobs 
related to their Navy rating reported less skill deterioration on job tasks 
than their counterparts who do not work in a related field. Civilian 
rating-related employment in most cases signficantly affected skill deteri- 
oration. Those continuing to work in their fields after EAOS reported less 
deterioration. Consequently, their needs for retraining were also less. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right 
the more important concern of this study was with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the impli- 
cations of skill deterioration data must be assessed against the criterion 
of acceptable, or minimum, level of proficiency. This can be done most 
directly by comparing the current proficiency levels reported by IRRs 
against the levels reported by active duty personnel. The task means for 
the active duty sample can be taken as E-4 criterion performance since they 
reflect the level of proficiency claimed by the average E-4 now on active 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be derived. Attention is directed to the "answer key" 
shown on either figure 1 or 2. The answer key shows that a value of "4 " 
for example, suggests that a respondent could perform all parts of the task 
with only a need for occasional supervision. Following conventional prac- 
V°Au " e a , s l ume th ** a .T reflected by any values between 3.50 and 4.49. 
A 3" is interpreted similarly. Thus, skill deterioration may be shown by 
lower mean values for NOW (i.e., current) versus EAOS proficiency. However, 
the change from EAOS scores may not be sufficient to move the IRR -espond- 

*? J* l0W< T- P roficienc y category. Thus, it could be concluded that 
skill deterioration occurred, but, in this case, the amount was insignifi- 

V« »T S ° f si 9. na . lin 9 a need for retraining. If the respondent had 
moved to a lower proficiency category, it might be concluded that retraining 
is needed* 3 

infn^M« Sment ° f , t S e j ra P lication s /or retraining of skill deterioration 
information can lead to very different conclusions depending on the 

ZlnZfil > t0 A„ m *\J he assessnMint - Often, the only information 

available to a study is the pre- and post-measurements-in our case, profi- 
ciency at EAOS and current (NOW) prof iciency-that are taken on all appro- 
priate group (s). In many studies, a proper conclusion could be that if 
significant amounts of deterioration occur, then retraining is needed to 
restore the individuals to some previous, higher level of proficiency. In 
the present study, the concern is not with the absolute amounts of deteri- 
oration that occurred, nor is it with returning irr s to their previous 
proficiency levels. Our direct concern is with the current proficiency of 
IRRs, and skill deterioration is of interest insofar as it determines 
current proficiency. The question is not, "What needs to be done to restore 
IRRs to their former proficiency levels?" The question is, rather, "Is thl 

SJ^ninS^ 101 ^ ° f IRRS * Suff , iC VL nt t0 support "<obilization without 
retraining?" Thus, assessment of the need for training IRR personnel 
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against mobilization should proceed with comparisons between IRR current 
competencies and the competencies now required on the active duty job. 

Table 15 presents grand mean values reported for current proficiency by 
IRR personnel who are not working in a field related to their rating, for 
those who are working in a related field, and for active duty personnel 
working in their rating* Inspection of the data shows that most values are 
essentially M 4"s. Hence, from these data alone, a fair conclusion is that 
large scale training of IRRs would not be required before mobilization to 
bring their proficiency to acceptable levels* However, this conclusion is 
at a general level across the ratings and the findings for individual 
ratings must also be considered (see appendices D-l through D-16). 

From assessments made at the rating level, we feel that the current 
level of proficiency of IRRs is probably sufficient to support mobilization 
for most of the ratings studied. There seems to be no need for extensive 
retraining or maintenance training for most IRRs prior to a mobilization 
recall. The average IRR should be ?ble to perform required job tasks at an 
appropriate level of competency with a modicum of refamiliarization at 
mobilization. For the most part, this could probably be given by close, 
corrective supervision while the returnee 1s performing job tasks. This 
conclusion is especially relevant to the IRRs who continue to work in a 
rating-related occupation. 

Exceptions to this general conclusion of minimum retraining occur for 
the CTI, CTO, CTR, CTT, and FTM ratings. Analyses conducted at the indi- 
vidual rating level Indicate that formal refresher training should be 
considered for all_ IRR CTIs, CTOs, and CTRs. Development of specialized 
premobil ization curricula using data provided by this study to Identify 
training emphases is recommended. Similarly, formal refresher training for 
CTTs and FTMs who are not currently employed in civilian jobs related to 
their Navy ratings should be considered. Once these five groups have 
reacquired "minimum" proficiency, periodic maintenance training should also 
be considered. 

An additional factor to consider in assessing needs for training 
concerns time since EAOS. Fifty-three percent of the IRRs in the sample 
were away from active duty for more than 3 years (see table 7). Subject 
matter experts who review the data provided here may determine that skill 
upgrade training is required because of technical changes (e.g., new equip- 
ment, materials, procedures) in the field. The concern here is with 
training IRRs for skills they have not previously possessed. 

VALIDATION OF OATA 

Our analyses indicate that, for the ratings studied, the need for 
training IRRs against mobilization requirements is not extensive. Required 
proficiency, defined as the level shown by current E-4 job incumbents (see 
column 2, table 15, and table 7 in each of the annexes to appendix D) can 
probably be achieved for most ratings through supervised practice. Instruc- 
tional modules for training prospective returnees on specific tasks may also 
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be beneficial. Additional information is needed, however, for firm deci- 
sions about training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the data provided by this report be evaluated/validated by 
resource sponsors against a number of other considerations mentioned below. 

Data Review 

The conclusions generated by the project staff are considered tentative 
and subject to verification. Generalizations are limited due to the small 
numbers of questionnaires returned and because of suspected IRR data base 
inadequacies. Nevertheless, much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the difficulties inherent in conducting skill 
deterioration research, as well as restrictions on methods that can be used 
because of practical considerations. Maximum exploitation of the infor- 
mation that is now available is in order. A complete and accurate assess- 
ment of the meaning and action implications of the data should be made by 
individuals who are thoroughly knowledgeable of technical requirements of 
the different ratings. The NAVTRASYSCEN, if requested, could assist SMEs in 
this effort. Areas to be considered in the review/validation process are 
discussed next. 

R eview Areas 

'.-"or our study, schoolhouse SMEs identified the job tasks they thought 
woula be appropriate for IRR members returning to active duty to perform. 
Other SMEs may not agree on the list. Resource sponsors should determine if 
these are indeed the job tasks that an IRR returnee (at mobilization) should 
be able to perform. A companion decision is required concerning the 
acceptability of the reported level of competency. Since active duty 
personnel reported that they, on the average, now perform at these levels, 
these data reflect E-4 criterion performance. Resource sponsors should con- 
sider whether less proficiency would be acceptable. If so, attendant 
training requirements and concomittant resource requirements would be 
lessened. In this regard, a key issue to be resolved is the meaning to be 
placed on the Oefense Guidance notion of "minimum" proficiency to support 
mobil-'zation. The term requires a specific definition so that training 
goals can be precisely defined. 

Op judging the need for training, task criticality, in terms of person- 
nel or equipment safety as it interacts with recent changes to material, 
procedures, or equipment, must also be considered. An additional decision 
factor concerns plans for utilization of IRR personnel upon mobilization 
recall. If these individuals (CTs for example) will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
Intermediate activity to provide needed training. 
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Finally, based on (1) the IRR members 1 reports of their current rela- 
tively high residual levels of proficiency and (2) literature findings that 
maximum skill loss probably occurs after about 1 year of nonuse of skills, 
it appears that skill maintenance training is not strictly necessary for 
most IRRs. We do recommend it for the IRRs in the ratings just mentioned 
above, however, okill deterioration effects, in these cases, did lower the 
IRRs 1 current proficiencies to the point where they could not be expected to 
be able to perform active duty job tasks at competency levels equivalent to 
those associated with current job incumbents. Maintenance training in these 
cases should preclude future adverse effects on proficiency. Again, how- 
ever, firm conclusions about maintenance training must be weighed against 
planned utilization of recalled IRR members. For example, a casualty 
replacement scenario would make maintenance training more desirable than 
other scenarios. 
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SECTION V 
CONCLUSIONS 

Based on a11_ data obtained during the study, a number of conclusions 
about the IRR, as represented by the 16 ratings studied, are possible. 
These are presented below in three areas: Oata Base, Skill Deterioration, 
and IRR Training Needs. 

OATA BASE 

1. The incorrect address rate in the IRR data files is net desirable. 

a. Mailing addresses were incorrect for approximately 30 percent 
of the CT IRRs. 

b. Mailing addresses were incorrect for about 10 percent of the 
IRRs in the other 10 ratings. 

2. The IRR data files may be incomplete or inaccurate in other areas. 
These deficiencies can lead to incorrect estimates of the size of the 
available manpower pool. The deficiencies involve data file content and 
procedures used in record keeping. 

a. There were indications from the questionnaires returned that 
a segment (of unknown size) of IRRs listed in the files, who did not return 
questionnaires, may have, for example, reenlisted, passed their 60th birth- 
day, or received final discharges. 

b. Almost 53 percent of the total group had been in the IRR more 
than 3 years. The percentages were exceptionally high for CTs. The reasons 
why so few CTs were in the under 3 years since EAOS group is unknown, but a 
record keeping problem is indicated. 

c. Many of the IRRs in the ratings studied may be beyond the 
zone of involuntary recall for mobilization. 

d. No "Last Release from Active Duty" information was contained 
in the IRR data filed for approximately 7 percent of the names in the rating 
samples drawn. Purging the files when an individual's MSO expires poses a 
potential problem for accurate record keeping. 

SKILL DETERIORATION 

1. Oe*erioration of skills acquired on active duty does occur during 
the time that individuals are assigned to the IRR. 

a. For most of the ratings studied, the proficiency of IRRs at 
the present time was reported to be less than the proficiency reported when 
they were on active duty. 
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2. Considerably less skill deterioration occurs for iRRs who, after 
EAOS, work in civilian jobs that are related to their Navy rating. 

a. IRRs who work in a rating-related civilian job gained profi- 
ciency on some job tasks in 11 ratings. The gains ranged from 9 percent to 
100 percent of the job tasks. 

b. For 15 of the ratings studied, IRRs who work in a civilian 
job related to the rating lost less skill on job tasks than those not simi- 
larly employed. 

3. Skill deterioration during IRR membership does not appear to be a 
major, general problem insofar as dictating needs for comprehensive retrain- 
ing of IRRs to support mobilization. 

a. For most of the ratings, the current proficiency levels of 
IRRs on rating job tasks compared favorably with the proficiency levels 
reported by individuals who are currently on active duty. Thus, many IRRs 
should be able to perform rating job tasks at mobilization without first 
being retrained. 

4. Skill deterioration effects on current IRR proficiency were suffi- 
cient in five ratings to indicate some needs for formal retraining. 

a. Disparities between active duty proficiency and current 
proficiency of IRRs in the CTI, CTO, and CTR ratings indicated training 
needs for all IRRs in these ratings. 

b. Disparities between active duty proficiency and current 
proficiency of the IRRs in the CTT and FTM ratings indicated training needs 
for the IRRs who were not currently working in a civilian job related to 
their rating. 

5. No firm conclusions about trends in skill deterioration over time 
were possible. 

a. Mean proficiency values computed over all ratings for 6-month 
time intervals since EAOS remained relatively constant over the intervals. 
Sample sizes may have been too small for a reliable assessment of trends. 

IRR TRAINING NEEDS 

1. Comprehensive retraining and maintenance training for all IRR ATs, 
BUs, CTAs, EMs, EOs, ETs, HMs, OSs, and STGs and for the CTTs and FTMs who 
now work in civilian occupations related to their ratings appear to be 
unnecessary prior to mobilization recall. Familiarization training at 
recall consisting of supervised practice may suffice. This conclusion is 
subject to concurrence by subject matter experts. 

2. Ret/aining and maintenance training for all CTIs, CTOs, CTRs and 
for the CTTs and FTMs not working in a civilian job related to their rating 
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may be necessary to support mobilization. Formal training is indicated. 
This conclusion is subject to concurrence by subject matter experts. 

3. Skill upgrade training should be considered for all IRR personnel 
who have been off active duty for greater than 3 years. Subject matter 
experts should determine the specific upgrade training needed based on 
changes to equipment, procedures, and materials used in job performance. 

4. Training needs for CTMs and GSEs could not be determined by the 
study because of the small sample sizes (l 1 and 10, respectively) available. 
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SECTION VI 
RECOMMENDATIONS 

A number of specific recommendations based on the findings of this 
study are provided below. 

1. Review, validate, and update the content of the IRR data files to 
assure that accurate assessments of the size of the IRR manpower pool are 
available at all times. Areas that should be included in this review con- 
cern accuracy and completeness of data pertaining to mailing addresses, 
member status, dates for completion of the military service obligation, and 
currency (and existence) of agreements stating continuing membership in the 
IRR and availability for recall. 

2. Review and correct, as necessary, the procedures used in updating 
and maintaining currency of the IRR data files. This recommendation stems 
partly from concerns of paragraph 1 above and partly from t„e pronounced 
lack of names in the IRR files of individuals separated from active service 
within the 3 years immediately preceding this study. In this regard, names 
for the CT ratings were most conspicuously absent. 

3. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for, or receiving, bonuses for 
continued IRR service. Consider individuals working in rating-related jobs 
as first choice for mobilization recall. 

4. Request resource sponsors review the data of this study: 

a. Determine if agreement can be reached that the tasks gener- 
ated by schoolhouse SMEs adequately represent the rating jobs. Determine 
that the E-4 job is, in fact, acceptable as the target performance level for 
retraining IRRs. If so, establish the proficiency levels reported by cur- 
rent E-4s as target levels for training (and as a definition of the term 
"minimum proficiency" to support mobilization. 

b. Request resource sponsors consider the study data against 
factors such as changes to materials, procedures, equipment used by the 
rating; criticality of task performance; and mobilization plans for IRR per- 
sonnel. Request resource sponsors promulgate IRR training requirements. 

5. Task the Naval Education and Training Command to initiate develop- 
ment of premobilization curricula for all CTIs, CTOs, CTRs, and for CTTs and 
FTMs not working in the field. Use the data of this study to identify 
particular job tasks to receive training attention. 

6. Consider recalling a sample of IRRs to assess their knowledge of 
current job requirements. Use this information to validate the data and 
conclusions of this study. 
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This appendix provides brief descriptions of the jobs performed on 
active duty by individuals holding the ratings listed. All descriptions 
were taken from the Blue Jackets ' Manual , 20th edition, United States Naval 
Institute. 
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JOB/TASK FUNCTIONS OF CRITICAL NAVY RATINGS 



AVIATION ELECTRONICS 
TECHNICAN (AT): 



BUILDER (BU): 



CRYPTOLOGIC TECHNICIAN (CT): 



Administrative (CTA) : 



Interpretive (CTI) ; 
Maintenance (CTM) : 



Communications (CTO) : 



Collection (CTR) : 



Technical (CTT) : 



ELECTRICIAN'S MATE (EM): 



• 



ATs are responsible for fie test, mainte- 
nance, and repair of radio, radar, and other 
electronic devices used for communications, 
navigation, controlled landing approaches, 
detection of (and guidance to) objectives, 
and neutralizing enemy equipment and tactics. 

Navy BUs may be carpenters, plasterers, 
roofers, cement finishers, asphalt workers, 
masons, painters, bricklayers, sawmill 
operators, or cabinet makers. BUs build and 
repair all types of structures, including 
piers, bridges, towers, underwater 
installations, schools, offices, houses, and 
other buildings, 

CTs control the flow of messages and informa- 
tion. The specific work they do depends on 
the career area in which they specialize. 
There are six areas. 

CTAs perform administrative and clerical 
duties involved in controlling access to 
classified information; 

CTI duties include radiotelephone communica- 
tions, and foreign language translation; 

CTMs install, service, and repair electronic 
and electromechanical equipment; 

CTOs operate Naval Security Group communica- 
tions systems; 

CTR duties involve Morse code communications 
and operation of radio direction-finding 
equipment; 

CTT duties involve communications by means 
other than Morse code, and electronic 
countermeasures. 

EMs operate and repair electrical power 
plants and electrical equipments. They also 
maintain and repair power and lighting 
circuits, distribution switchboards, 
generators, motors, and other electrical 
equipment. 
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EQUIPMENT OPERATOR (EO): 



ELECTRONICS TECHNICIAN (ET): 



FIRE CONTROL TECHNICIAN 
(SURFACE MISSILE) (FTM): 



EOs operate heavy machi nery such as 
bulldozers, power shovels, pile drivers, 
rollers and graders, etc. 

ET duties involve maintaining, repairing, 
calibrating, tuning, md adjusting all elec- 
tronic equipment used for communications, 
detection and tracking, recognition and 
identification, navigation, and electronic 
countermeasures- 

FTMs maintain and repair fire control 
systems, including radars, weapons direction 
systems, target designation systems, and 
el ectro-hydraul i c f i re-control ser vo- 
mechanisms. 



GAS TURBINE SYSTEM TECHNICIAN 
(ELECTRICICAL) (GSE): 



HOSPITAL CORPSMAN (HM): 



OPERATIONS SPECIALIST (OS): 



GSEs operate, repair, and maintain gas 
turbine engines, main propulsion machinery 
(including gears, shafting and controllable 
pitch propellers), assigned auxiliary equip- 
ment, propulsion control systems, electrical 
and electronic circuitry up to the printed 
circuit modules, and alarm and warning 
circuitry. They perform administrative tasks 
related to gas turbine propulsion system 
operation and maintenance. 

HMs assist medical professionals in providing 
health care to service people and their 
families. They act, for example, as pharma- 
cists, medical technicians, food service 
personnel, nurses' aids, physicians 1 or 
dentists 1 assistants, battlefield medics, 
X-ray technicians. HMs 1 work falls into 
several categories: first aid and minor 
surgery, patient transportation, patient 
care, prescriptions and laboratory work, food 
service inspections, and clerical duties. 

OSs operate radar, navigation, and communica- 
tions equipment in shipboard combat informa- 
tion centers or on bridges. They detect and 
track shi ps , pi anes , and mi ssi les . They 
operate and maintain IFF (identification 
f r i end or foe ) systems , ECM (el ectron i c 
countermeasures) equipment, and radio 
telephones. 
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SONAR TECHNICIAN (SURFACE) STGs are responsible for underwater surveil- 
(STG) lance, assistance in safe navigation, aiding 

in search and rescue, and attack operations. 
They operate and repair sonar equipment and 
jam enemy sonars. They track underwater 
objects and repair antisubmarine warfare 
fire-control equipment and underwater radio 
telephones. 
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APPENDIX B 

ACTIVITIES VISITED FOR JOB TASK INFORMATION 
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This appendix identifies the activities visited to obtain job task 
information needed for the IRR study of skill deterioration. Conmands 
granting visit authorization are also identified. 
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The table below identifies Naval commands granting authorization for 
visits by NAVTRASYSCEN project staff to obtain information needed for the 
IRR skill deterioration study. The rating involved is identified and the 
location of the "A" School, or other activity, providing SME assistance is 
given. Concurrence of Chief of Naval Education and Training (CNET) was 
obtained for CNET's subordinate commands. 

Table B-l 

Activities Providing Job Task Information 



Rating 



Location 



A. Chief of Naval Technical Training 



Electrician's Mate (EM) 
Electronics Technician (ET) 
Fire Control Technician 

(Surface Missile) (FTM) 
Gas Turbine Systems Technician 

(Electrical) (GSE) 



Service School Command, Great Lakes, IL 

Service School Command, Great Lakes, IL 

Service School Command, Great Lakes, IL 

Service School Command, Great Lakes, IL 



Builder (BU) 

Equipment Operator (EO) 



Naval Construction Training Center, 

Gulfport, MS 
Naval Construction Training Center, 

Gulfport, MS 



Aviation Electronics Technician 
(AT) 



Naval Air Technical Training Center, 
Memphis, TN 



Cryptologic Technician 
(Administrative) (CTA) 

Cryptologic Technician 
(Maintenance) (CTM) 

Cryptologic Technician 
(Communications) (CT) 

Cryptologic Technician 
(Collection) (CTR) 

Cryptologic Technician 
(Technical) (CTT) 

Cryptologic Technician 
(Interpretive) (CTI) 



Naval Technical Training Center, 
Corry Station, Pensacola, FL 

Naval Technical Training Center, 
Corry Station, Pensacola, FL 

Naval Technical Training Center, 
Corry Station, Pensacola, FL 

Naval Technical Training Center, 
Corry Station, Pensacola, FL 

Naval Technical Training Center, 
Corry Station, Pensacola, FL 

Naval Technical Training Center 
Detachment, Goodfellow AFB, TX 
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Table B-l (Continued) 



Rat ir.'. Location 



3. Commander Training Command, U.S. Pacific Fleet 

Sonar Technician (Surface) (ST6) Fleet Anti -Submarine Warfare Training 

Center, Pacific, San Diego, CA 



C. Commander Training Command, U.S. Atlantic Fleet 

Operat'ons Specialist (OS) Fleet Combat Training Center, 

Atlantic, Dam Neck, VA 



0. Commander, Naval Regional Medical Center 
Hospital Corpsman (HM) Staff, Navy Hospital, Orlando, FL 
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APPENDIX C 

COVER LETTERS USED FOR TRANSMISSION OF QUESTIONNAIRES 
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This appendix provides copies of cover letters used to transmit 
questionnaires to both IRR personnel and active duty personnel in the 
following order: 

Sample IRR Questionnaire Transmittal Letter 
Follow-up Transmittal Letter to IRR Personnel 
Transmittal Letter to Unit/Activity Commanders 
Letter to Active Duty Personnel 
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SAMPLE IRR QUESTIONNAIRE TRANSMITTAL LETTER 
DEPARTMENT OF THE NAVY 

OFFICE OF THE CHIEF OF NAVAL OPERATIONS 
WASHINGTON, DC 20350 



IN REPLY REFER TO 



1001 

Ser 113E2/368487 



From: Director. Total Force Manpower Requirements. Education and 
Training Division (OP-11) 

To: 



Subj: REQUEST FOR INFORMATION 

End: (1) skill Retention Questionnaire 

1. The Navy is currently reviewing the Individual Ready Reserve 
(IRR) program. The IRR consists of Navy personnel who have 
fulfilled their active duty obligation and are now assigned to 
the inactive reserve until completion of their service contract. 
As a member of the IRR. you can help us by completing and 
returning the enclosed questionnaire. 

2. During your active service you acquired specific professional 
and technical skills critical to the performance of your rate. 
The purpose of this questionnaire is to determine how many, if 
any. of these skills have been lost since your release from 
active duty. He are conducting this survey as part of a study to 
determine what training you would need to retain, regain or 
upgrade these skills should some future national emergency make 
it necessary to recall reserve forces to active duty. 

3. Your participation is strictly voluntary, but it is 
important. I urge you to take a few minutes and complete the 
attached questionnaire. Please answer all questions to the best 
of your knowledge. Then fold the paper so the return address is 
on the outside, tape or staple it closed and drop the survey in 
the mailbor. No postage is needed. Your prompt responses would 
be greatly appreciated. 

4. I wish to thank your for your time and cooperation. Your 
participation will help to improve Naval readiness in the event 
of national emergency. 
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D. 0. PRIUEAU 

Director, Total Force _ 
Manpower Eequircaents, Education" 
and Training Division 



FOLLOW-UP TRANSMITTAL LETTER TO IRR PERSONNEL 




DEPARTMENT OF THE NAVY 
NAVAL TRAINING EQUIPMENT CENTER 



ORLANDO, FLORIDA 32813 



1500 

Ser 1/186 
W1213 



IN RIFIV fltPtfl TO 



J. 



From: Commanding Officer, Naval Training Equipment Center 
To: Navy Individual Ready Reserve Member 

Subj: SECOND REQUEST FOR INFORMATION 

End: (1) Skill Retention Questionnaire 

1. Recently, you received a letter from the Office of the Chief of Naval 
Operations. A questionnaire asking about your former Navy job was enclosed. 
The questionnaire sought information that only former service personnel like 
you can provide, information about how Navy skills change after an 
individual's separation from active duty. 

2. We have not received a response from you. In case you have mislaid the 
original questionnaire, a new copy is enclosed. Your participation is 
strictly voluntary, but it is important. Please take a few minutes to 
answer the questions. Then fold the paper so the return address is on the 
outside, tape or staple it closed, and drop the survey in a mailbox. No 
postage is needed* 

3. I wish to thank you for taking the time to complete the questionnaire. 
Your information is needed to support Navy long-term planning. 
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TRANSMITTAL LETTER TO UNIT/ACTIVITY COMMANDERS 
DEPARTMENT OF THE NAVY 

OFFICE OF THE CHIEF OF NAVAL OPERATIONS 
WASHINGTON, DC 20350 

IN REPLY REFER TO 



5223 
Ser 01R1/ 

16 SEP 1985 



From: Chief of Naval Operations 
To: 



Subj: INDIVIDUAL READY RESERVE (IRR) STUDY 

Ref: (a) CNO Itr ser 113E/368974 of 28 Nov 83 

(b) COMNAVSECGRU ltr 5223 Ser G131/1723 of 18 Jan 85 
(liOTAL) 

(c) CINCLANTFLT ltr 5223 Ser N141A/001131 of 4 Feb 85 
(NOTAL) 

(d) CINCPACFLT ltr 5223 Ser 73/3186 of 15 Apr 85 (NOTAL) 

Encl: (1) Listing of Personnel To Be Surveyed 
(2) Individual Requests For Information 

1. The Naval Training Equipment Center ( NAVTRAEQUI PCEN ) has 
been tasked in reference (a) to study skill degradation and 
retraining requirements. As part of the study, it is necessary 
to survey some of your active duty personnel. Enclosure (1) 
lists those personnel who have been randomly selected and are 
reported to be in your command. Please distribute the appro- 
priate portions of enclosure (2) to the designated personnel. 
Completed questionnaires are to be mailed by 31 October 85 
directly to the NAVTRAEQUIPCEN (Code 10). Orlando, Florida, 
32813. If personnel listed are no longer attached to your 
command, return the blank questionnaire to NAVTRAEQUIPCEN with 
a notation of the aopropriate address if known. 

2. This fleet survey is authorized by references (b), (c) and 
(d) . The survey will provide invaluable information in deter- 
mining what retraining, regaining, or upgrading should take 
place should a national emergency make it necessary to recall 
IRR personnel to active duty. OPNAV Report Control Symbol 
RCS:0PNAV 1514-2 (0T) has been assigned to this survey and is 
valid until 31 December 85. 
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Assistant Deputy Chief of 
Naval Operations (Manpower, 
personnel and Training) Acting 



LETTER TO ACTIVE DUTY PERSONNEL 



DEPARTMENT OF THE NAVY 

OFFICE OF THE CHIEF OF NAVAL OPERATIONS 
WASHINGTON. DC 20350 

- - IN «*EPL Y Rrf ER TO 

Ser 01R1/ 

From: Chief of Naval Operations 
To: 

Subj: REQUEST FOR INFORMATION 

Encl: (1) Job/Task Performance Questionnaire 

1. Your participation is important. Please complete enclosure 
(1) by answering all questions to bhe best of your knowledge. 
Then fold the paper so the return address is on the outside, tape 
or staple it closed, and drop the survey in the mailbox. No 
postage is needed. Your prompt response will be greatly 
appreciated. 

2. During your active Naval service, you have acquired specific 
skills critical to the performance of your rating. The purpose 
of enclosure (1) is to determine what skills are currently used 
and your pr >ficiency in performing that skill, and your estimate 
of how well you could perform the same skills after a two year 
separation from the Navy. 

3. The Navy is currently reviewing the Individual Ready Reserve 
(IRR) program. The IRR consists of Navy personnel who have been 
released from active duty but have not completed their military 
service obligation and are now assigned to the reserve until 
completion of this obligation. This survey is part of a study to 
determine what training is necessary to retrain the IRR personnel 
in critical skills should a national emergency make it necessary 
to recall reserve forces to active duty. 

4. I wish to thank you for your time and cooperation. Your 
participation will help to improve Naval readiness. 





AssistantM)eputy Chief of 
Naval Operations (Manpower, 
Personnel and Training) Acting 
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APPENDIX 0 
STUDY RESULTS FOR 16 RATINGS 
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DESCRIPTION OF CONTENTS 



Appendix D is composed of 16 annexes. Each annex presents the results 
of this skill deterioration study for one particular rating (e.g., HM, ET). 
Each annex is a stand-alone document that may be separated from this report 
for the convenience of those interested only in (a) particular rating(s). 
All 16 annexes are identically formatted. A brief introduction, followed by 
a concise summary of the technical approach, is given. Study results 
pertaining to the particular rating are presented next. Comments pertinent 
to data interpretation are provided. Finally, conclusions pertaining to 
needs for training of IRR members, and recommendations based on the data are 
presented. 

The annexes and the rating cov^ed by each are listed below: 



Annex 



Rating Covered 



1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 



AT 

BU 

CTA 

CTI 

CTM 

CTO 

CTR 

CTT 

EM 

E0 

ET 

FTM 

GSE 

HM 

OS 

STG 
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APPENDIX D 
ANNEX 1 



AVIATION ELECTRONICS TECHNICIAN (AT): 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO). Other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the ^rmed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by 0P-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Aviation 
Electronics Technician (AT) rating was one of these 16. 



PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed, and to define 
the terminal performance goals that any proposed training regimen should 
attempt to achieve. 



APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Four senior 
enlisted ATs, assigned to the Aviation Electronics Technician School, Naval 
Air Station, Memphis, TN, served as subject matter experts (SME) for 
questionnaire development. Under guidance given by the project staff, the 
AT SMEs selected from various source materials a set of job tasks that, in 
their judgment, best represented the job (non-NEC specific) of an active 
duty AT-3. This level was chosen in the belief that a recalled ready 
reservist who could perform job tasks competently at the E-4 level would 
make a positive work contribution to a receiving unit. 



D-l-3 

ERIC ?(J 



Technical Report 86-007 



The AT-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency wou'.d reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty AT- 3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty AT-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. They also set an upper 
limit on the proficiency levels that training must achieve to maintain at or 
restore skills to acceptable levels. Copies of these data collection 
instruments are shown in the next section. 

As of 25 September 1984, 1,025 ATs were listed in Naval Military 
Personnel Command (NMPC) computer files as assigned to the IRR. Names and 
addresses were obtained from NMPC through the Naval Reserve Personnel Center 
(NAVRESPERSCEN). Questionnaires were mailed on 21 November 1984 under CNO 
(OP-11) cover letter to a random sample of 500 (48.8 percent). Because of a 
low initial return rate, a follow-up mailing (340) was made on 29 January 
1985. Questionnaire returns were accepted until 28 February 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), and 
within CNO (OP-01) was accomplished for authorization to survey active duty 
AT-3 personnel. An AT-3 roster, current as of 2 August 1985, was obtained 
from NMPC. From a pool of 2,634, a sample of 427 AT-3s was determined using 
accepted survey research methods. Questionnaires were mailed on 18 
September 1985 under CNO (OP-11) cover letter to unit/activity commanding 
officers for distribution to AT-3s named. Returns were accepted until 31 
December 1985. Returned questionnaires were scanned to determine data 
usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of AT skill deterioration are 
presented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table D-l-1 shows, for both the IRR and active duty ATs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
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sample, the number/percent of nonvalid returns (nonvalid principally because 
of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (214) by the number delivered (i.e., 500 - 46 = 
454) . 

Table D-l-1 
Questionnaire Return Statistics 

Usable Returns Nonvalid 
Sample No. Mailed No. % No. % 

IRR 500 212 47 46 9 

Active Duty 427 257 60 



QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
taole D-l-2 for IRR personnel and in table D-l-3 for active duty personnel. 
The tables are modified questionnaire forms. 

Background Questions 

Of 208 IRR ATs answering the question, 110 (approximately 53 percent) 
reported that they now work in a civilian occupation related to their Navy 
AT rating. Answers to the remaining two background questions for IRRs (see 
table D-l-2) are not reported since it was determined that the answers would 
be redundant and could not be unambiguously interpreted. Of the active duty 
respondents answering the background questions (see table D-l-3), 233 of 254 
(92 percent) work in rating. Ninety-eight of 252 (39 percent) are assigned 
sea duty. 

Task Performance Data 

The data sumrary tables (D-l-2 and D-i-3) show the number (F) and 
percent (%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
1. ) For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of data (r = .785, p < .05) 
indicated significant agreement between the two classel of respondents. 
Thus, tasks which have not been performed frequently by active duty ATs (to 
date) are the same tasks that had not been performed frequently by IRRs at 

Tables D-l-2 and D-l-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
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Table D-l-2 

Overall Summary of AT IRR Questionnaire Data 



FAIT 1: 



ANSWER KEY: 



1. If necessary, correct your Service 



4. 



la the work which you do rfOW related 
to your levy rat ins? 

Yaa 110 lo 98 

Have you flone PIEVIOUS work which is 
related to your levy rating 
since your Expiration of Active 
Obligated Service (EA08)T 

Yea - lo - 

Have you received training related to 
your levy rating since your Expiration 
of Active Obligated Service (EAOS)T 
Yes So - 



(1) Have never performed the tesk. 

(2) Can/could do simple parte of the tesk 
(need direct supervision). 

(3) Can/could do seat parts of the tesk 
(need general supervision). 

(4) Can/could do all parts of the task 
(need only occasional supervision. 
Meets mlnisua locel speed and accuracy 
standards.) 

(5) Can/could do complete task quickly end 
accurately (need no supervision) . 



PART 2: 

For each job task statement below: 

A. Indicete your CURHEET level of ability according to the answer key above. 

B. Estimate your PREVIOUS level of ebillty at the tine of your EAOS according to 
the answer key above. 



"(1)** Choices 
E * 



Tesks 



12 5.7 1. Troubleshoot electronics circuits 
to a defective component. 

28 13.5 2. Repeir or replace defective 
conponents on e circuit card. 



A B 

1 Mean SD H Meen SD 

211 3.64 1.299 209 3.75 1.239 

210 3 . 82 1 . 442 208 3.66 1 . 425 



4 1.9 3. Use general purpose test equipment 211 4.31 1.013 208 4.31 1.013 
(e.g., o-scope, multimeters) to 
aeasure voltages and resistance, 
and to observe waveforms. 



12 5.8 4. isolate awl functions to a line 
repleceeble unit. 



209 4.06 1.167 207 4.29 1.016 



7 3.3 5. Assist in troubleshooting end repair 210 3.81 1.207 209 4.27 1.036 
of avionics sys tests. 



6 2.9 6. use schematlca/block diagrams to 
maintain avionica equipment. 



210 4.C8 1.126 208 4.32 1.000 
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10 4.8 7. AMtat in Minttlnint tha tochnlcol 210 3. 81 1.230 20a * it , 

library, tool Inventory, tralnlns 4,M 1087 

rocordo. and toot oqulpoont Inventor?. 

• 3.8 8. Fobrlcoto. toot end rapalr Intor- 209 » it 1 147 237 * „ , 

coimectln, electronic ceblee. 237 422 1041 

• 3.9 9. uoc publlcetlona oad Mintononeo 208 3.76 1 248 205 * to * 

Information mtrUwl eyotea to 205 4,M 1075 

lnepeet, oorvlco, ond aelnteln 
evlonlco eye ten*. 

conditional lnap*ctlon* of olrccaft 
and ovlonlco niilpwnt. 

9 4.3 12. Coaploto ■«int*ianco dmU fom 200 « «a i 

OUT/SAT). 3,38 1,212 208 1.048 

33 15.$ 13. Prapora aircraft frr around 211 * i* t m ™« 

aalntonaoco and obUln ™e. Mry 2U 3 12 X ' 441 209 1506 

t round aupport equipment. 

15 7.2 14. Identify and troot corroelon; opply 210 3.50 1 284 200 a a* 

corroelon prevention aeacureo. 4,02 1,226 

• 2.9 13. inopoet ond repleee electrfcel 210 a «<» ><a 

circuit protective devlcee 4,52 M0 209 *'«* M 3 

(e.g.. fuooe, circuit broakoro). 

3 2 4 M. inapoct. cloan. and oorvlco 210 4 18 1 no«s . « 

evlonlco oqulpMnt or oyotoM. 1 0,3 208 4 M • 77 

3 1.4 17. UO. and .alnt.l» b«dtOOl.. 210 4.74 ..64 208 4.77 .684 

7 3,6 S^SLS* wl ~ »• 4 24 1144 »> • » -m 

19. To what laval of aaiatonanco wtra 
you aaolanad whilo on aetlva dutv 
(0, I, both. nalthar)t 

Ovarall Moan: 3.94 
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Table D-l-3 

Overall Summary of AT Active Duty Questionnaire Data 



PART 1: 



ANSWER KEY: 



1. If necesaary, correct /our Service 



2. Does your current billet require you 
to work In your levy rating? 

Yee 233 Mo 21 

3. Whet type duty le your current 
billet? 

See 98 Shore 154 



(1) Have never performed the teak. 

(2) Can/ could do simple parte of the teak 
(need direct aupervlalon). 

(3) Can/could do moat parti of the teak 
(need general aupervlalon). 

(4) Can/could do all parte of the teak 
(need only occasional aupervlalon. 
Meeta minimum local apeed and accuracy 
etendarda . ) 

(5) Can/could do complete teak quickly and 
eccurately (need no eupervlelon) . 



PAST 2: 

For each job taek atatement below: 

A. Uae the answer key above to Indicate your CUBREMT level of ability. 

B. Uae the answer key above to eatlmate your EXPECTED level of ability after 2 
years of Qfi£ performing theae taaka. 



"(1> M Cholcei 



Taaka 



8 5.4 1. Trouble ihoot electronic! circuit! 
to a defective component . 

41 16.0 2. Repair or replace defective 
component! on a circuit card. 



A B 

I Mean SD ■ Mean SD 

257 3.70 1.115 249 3.00 .952 

256 3 . 53 1 . 458 247 3 . 10 1 . 244 



5 1.9 3. Uae general purpoae teet equipment 257 4.50 .871 252 3.79 1.005 
(e.g.. o-i cope, multimeter*, to 
measure voltages and reilitance, 
and to observe waveforms. 



24 9.4 4. Isolate malfunctions to a line 
replaceable unit. 



254 4 . 05 1 . 215 249 3 . 29 1 . 102 



11 4.3 5. Assist In troubleshooting and repair 256 4.23 1.C38 249 3.51 1.036 
of avlonlca lyiteme. 



6 2.3 6. Uae ichemetlcs /block diagrams to 
maintain avlonlca equipment. 



?56 4.33 .913 250 3.66 1.034 



8i 



0-1-8 



Technical Report 86-007 
Table D-l-3 (Continued) 



9 3.5 7. Assist In Maintaining tha tachnlcal 257 3.98 1.079 252 3.37 1.151 
library, tool Inventory, training 
racords, and tost aquipaant invantory. 

24 9.3 6. pabrlcata, tost and rafale intar- 257 3.93 1.254 250 3.46 1 199 
connecting alaetronle ca'»las. 

9 3.5 9. Usa publications and nakntananea 257 4.19 .958 250 3.54 1.014 

information ratrlaval firsts* to 
lnspact, sarvlca, and aaintaln 
avionics systsas. 

5 2.0 10. Coapiy with Poralgn Objact Daaaga 256 4.71 .748 250 4.38 942 
(POD) Pros ram. 

46 17.9 11. Using Htc cards, parfora daily, pra- 257 3.74 1.517 252 333 1362 
flight, post flight, turnaround, and 
conditional inspactions of aircraft 
•nd avionics aquipaant . 

5 2.0 12. Coaplata aalntananca data forna 254 4.29 . 911 249 % 21 1 ai% 

(MAP/SAT). J 

82 32.2 13. Prapara aircraft for ground 255 3.19 1.725 249 2.81 1 473 

M*"tananca and obtain nacassary 
ground support aquipaant. 

8 3.1 14. identify and traat corrosion; apply 257 4.09 1.017 251 3,41 1,104 
corrosion pravsntlon measures. 

8 3.1 15. Inspect and replace electrical 256 4.71 .819 252 439 941 

circuit protactlva devices 
<•.$•• fusas, circuit braakara). 

• 2.3 16. insptct, clean, and sarvlca 257 4.49 .862 251 3.98 1 002 

avionics equipment or systems. 

5 1.9 17. Usa and Maintain hand tools. 257 4. 81 .666 253 4.62 .82 

24 9.6 18. Sacura and safaty wire equipment 251 4.10 1.283 247 3 77 1 «oa 

and components. 

19. To what laval of maintenance were 
you assigned while on actlva duty 
(0, Z, both, naithar)? 
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standard deviation (SD) around the mean, and the number of cases (n) on 
which a mean is based. For the I."R sample, table D-l-2, the "A" column 
reflects current average ability level; the "B" column, EAOs, average 
ability level. For the active duty sample (table D-l-3), the "A" column 
refers to current (NOW) ability and the "B" to proficiency expected after 2 
years of nonperformance of a task.l A Pearson Product Moment Correlation 
(r ■ .911, p<.05) computed between task means for IRR EAOS and active duty 
NOW (current proficiency) values indicated that the IRR members, while on 
active duty, performed job tasks at competency levels equivalent to those of 
current job incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the AT-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean = 3.9). 

For the active duty group, means reflecting proficiency on each job 
task for ATs working/not working in their rating were computed. These are 
shown in table D-l-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-l-5 displays task proficiency means for two subgroups of the AT 
IRR respondents: (1) those who answered that they were now working , "W," in 
a field related to the Navy AT rating and (2) those who indicated that they 
were not working in a related field, M N." Both EAOS and NOW (current) 
proficiency means are given. These means, as well as those in table D-l-4, 
were computed from choices of 2, 3, 4, or 5 from the answer key. These 
choices place proficiency along a continuum from "Need direct supervision" 
through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-l-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 
membership: current proficiency *s less than EAOS proficiency. Values with 
no signs indicate increases in proficiency. 

The table shows that ATs who now work ("W") in a field related to their 
former active duty jobs gained proficiency on 7 of the 18 job tasks. 
Although the individual task differences are net large, this "W" group also 
reported less skill deterioration than the "N" group for all but one of the 
other rating tasks. Statistical tests (t tests for independent means; see 
Guilford and Fruchter. 1973) indicated that over all tasks of the rating, 
proficiency of the two subgroups was equivalent at EAOS (t = .34, p_<.3664). 



iThese expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since it was clear that many respondents did not 
understand the question being asked. 
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Table 0-1-4 

Task Mean Values for Two Subgroups of Active Duty ATs 



Not Working ("N") A Working ("W'T 

Task NOW EXP NOW EXP 



1 


3.778 


2.722 




3.857 


3.081 


2 


3.813 


3.375 




4.030 


3.387 


3 


4.111 


3.632 




4.610 


3.842 


4 


4.235 


3.368 




4.386 


3.476 


5 


4.105 


3.556 




4.404 


3.579 


6 


4.056 


3.333 




4.437 


3.709 


7 


4.211 


3.944 




4.062 


3.394 


8 


4.222 


3.611 




4.229 


3.633 


9 


4.176 


3.588 




4.307 


3.571 


10 


4.700 


4.368 




4.789 


4.433 


n 


4.286 


3.800 




4.338 


3.704 


12 


4.053 


3.100 




4.383 


3.318 


13 


4.462 


3.786 




4.203 


3.553 


14 


3.944 


3.389 




4.215 


3.467 


15 


4.722 


4.278 




4.833 


4.484 


16 


4.235 


3.813 




4.589 


4.035 


17 


4.750 


4.429 




4.900 


4.714 


18 


4.286 


4.000 




4.424 


3.976 




Composite Mean: 


Group W 


NOW 


4.389 










EXP 


3.742 








Group N 


NOW 


4.230 










EXP 


3.672 






Overall Mean: 




NOW 


4.309 





EXP 3.707 



In = 21 
2 n = 233 
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Table D-l-5 

Task Mean Values for Two Subgroups c" IRR ATs 

Not Working ("N") 1 Working ("W") 2 Mean Difference 

Task NOW EAOS NOW EAOS "N" "W" 



1 


3.221 


3.711 


4.368 


4.087 


-0.490 


0.281 


2 


3.737 


3.946 


4.615 


4.194 


-0.209 


0.421 


3 


3.918 


4.277 


4.750 


4.467 


-0.359 


0.283 


4 


3.769 


4.371 


4.625 


4.583 


-0.602 


0.042 


5 


3.702 


4.337 


4.273 


4.423 


-0.635 


-0.150 


6 


3.787 


4.271 


4.552 


4.553 


-0.484 


-0.001 


7 


3.854 


4.370 


4.206 


4.291 


-0.516 


-0.085 


8 


3.978 


4.326 


4.571 


4.356 


-0.348 


0.215 


9 


3.725 


4.341 


4.150 


4.291 


-0.616 


-0.141 


10 


4.484 


4.777 


4.396 


4.721 


-0.293 


-0.325 


11 


3.765 


4.470 


3.944 


4.302 


-0.705 


-0.358 


12 


3.438 


4.457 


3.786 


4.490 


-1.019 


-0.704 


13 


3.623 


4.405 


3.767 


4.181 


-0.782 


-0.414 


14 


3.787 


4.411 


3.663 


4.139 


-0.624 


-0.476 


15 


4.333 


4.663 


4.876 


4.819 


-0.330 


0.057 


16 


4.126 


4.663 


4.545 


1.619 


-0.537 


-0.074 


17 


4.680 


4.821 


4.861 


4.822 


-0.141 


0.039 


18 


'4.368 


4.744 


4.500 


4.545 


-0.376 


-0.045 






Composite Mean: 


Group W 


NOW 4.358 







EOS 4.438 

Group N NOW 3.905 

EOS 4.409 

Overall Mean: NOW 4.132 

EOS 4.423 



!n - 98 
2 n = 110 
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Task mean proficiency values, however, differed significantly (t = 3 6b 
£<.0004) for current (NOW) proficiency. 9 ~ ' 

TIME IN IRR 

too Table P' 1 ' 6 P rovides a breakdown of AT personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
those iRRs who have been off active duty more than 3 years. 

Table D-l-6 

tean Proficiency Values for AT IRR Respondents by Time Since EAOS 



Time (Mos.) 
Since EAOS 


Mean 


No. of Cases 


0-5 


3.79 


28 


6-11 


3.82 


20 


12-17 


3.85 


39 


18-23 


4.09 


6 


24-35 


4.21 


14 


36+ 


4.00 


75 


Overall Mean 


3.94 


182 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted 
interpretations are made and discussed. These interpretations provide the 
\l « certf \ ,n .conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
juoject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 

t n e lll U l l % The ? a l?° J^ g . gest Actions that should be taken with respect 
to the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

«nnnw^?HS X \?l e il y n 9 n P fx Cent T 0f *"»«onni1rts returned were classified as 
nonvalid" (table 0-1-1) They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
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returned by the Postal Service as unde liver able (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from another 
service, was never on active duty in the Navy." (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 1985). Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased." From the above data, it can be concluded that about 9 
percent of the AT IRRs could not or would not be available for a 
mobilization call. 

Questionnaires were presumably delivered by the Postal Service to a 
number of IRR ATs (53 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above— they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the AT 
IRR roster 4 

Another data base issue that should be examined concerns the amount of 
time that IRR AT respondents have been away from active duty. This 
information is given in table 0-1-6. Forty-one percent were in the IRR for 
more than 3 years. Two issues emerge: (1) the need for skill upgrading and 
(2) availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group despite their beliefs 
(table D-l-6) in their continuing ability to perform job tasks at a fairly 
high level. 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

SKILL DETERIORATION 

Infcrmation directly pertinent to the question of skill deterioration 
was presented in table 0-1-5. In table 0-1-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 53 percent of AT IRRs reported that they now work in a 
civilian occupation related to the AT rating and the effects of this work 
experience on skill deterioration will be considered next. As table 0-1-5 
shows, ATs who now work in a field related to their Navy rating actually 
gained proficiency on seven job tasks. They also reported less skill 
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deterioration than the "N" subgroup for all but one other job task. Taken 
over all tasks, differences between the current (NOW) proficiency means for 
the two subgroups were statistically significant. Also, they could not be 
attributed to initial differences between the groups at EAOS. Thus, 
civilian AT-related employment significantly affected skill deterioration. 
Those continuing to work in the field after EAOS reported less 
deterioration. The task; on which the greatest amount of skill 
deterioration occurred are easily identifiable from table 0-1-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need vor 
training IRR personnel prior to a mobilization recall. Thus, the 
implications of skill deterioration data must be assessed against the 
criterion of acceptable level of proficiency. This can be done most 
directly by comparing the current proficiency levels reported by AT IRRs 
against the levels reported by active duty AT-3s. The task means for the 
active duty sample can be taken as E-4 criterion performance since they 
reflect the level of proficiency claimed by the average AT-3 now on active 
duty. 

The meaning cf specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on f.ither table D-l-2 or D-l-3. The answer key shows that a value of 
"4," for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
"4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
proficiency category. For example, sizable skill loss on tasks 10 to 15 
occurred for the IRRs working in a related field. However, the losses 
reported resulted in the IRRs remaining in the "4" category (see table 
D-l-5). We would conclude that the deterioration is of no consequence 
insofar as signaling a need for retraining. 

Assessment of the need for training IRR personnel to support 
mobilization should proceed with the application of similar logic. Table 
D-l-7 below presents the task mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the AT rating and 
also for those who are working in a related field. These values are from 
table D-l-5. Task proficiency means for active duty personnel working in 
their rating (taken from table D-l-4) are also shown in table D-l-7. 
Inspection of the data shows that all values are essentially "4 M s for those 
ATs working in a field related to the rating, and not much lower for those 
not working in a related field. The lowest mean value reported, 3.2 for 
task 1, still indicates the ability to do most parts of the task with only 
general supervision. Hence, from these data alone, a fair conclusion is 
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that training of AT IRRs with the possible exception of the two tasks shown 
would not be required before mobilization to bring proficiency to an 
acceptable level. 



Table D-l-7 

Task Mean Proficiency Values for IRR and Active Duty ATs 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


1 


3.2* 


4.4 


3.S 


2 


3.7 


4.6 


4.0 


3 


3.9 


4.8 


4.6 


4 


3.8 


A C 

4.0 


A A 

4.4 


5 


3.7 


4.3 


4.4 


6 


3.8 


4.6 


4.4 


7 


3.9 


4.2 


4.1 


8 


4.0 


4.6 


4.2 


9 


3.7 


4.2 


4.3 


10 


4.5 


4.4 


4.8 


11 


3.8 


3.9 


4.3 


12 


3.4* 


3.8 


4.4 


13 


3.6 


3.8 


4.2 


14 


3.8 


3.7 


4.2 


15 


4.3 


4.9 


4.8 


16 


4.1 


4.5 


4.6 


17 


4.7 


4.9 


4.9 


18 


4.4 


4.5 


4.4 


♦Probable training need. 







From our assessment, there seems to be no need for extensive retraining 
or maintenance training of ATs prior to mobilization. The average IRR AT 
should be able to perform required job tasks at an appropriate level of 
competency with a modicum of refamiliarization at mobilization. For the 
most part, this could probably be given by close, corrective supervision 
while the returnee is performing job tasks. This conclusion pertains to all 
ATs but is probably especially relevant to the 53 percent of IRR ATs who 
continue to work in an AT-related occupation. 

An additional factor to consider in assessing needs for training, 
however, concerns time since F.AOS. Forty-one percent of the AT IRRs in the 
sample were away from active duty for more than 3 years (see table 0-1-6). 
Subject matter experts who review the data provided here may determine that 
skill upgrade training 1s required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 
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VALIDATION OF DATA 

Our analyses indicate that the need for training of AT IRRs against 
mobilization requirements is not great. it would appear that required 

£«Vf?f ^J 6 ? 1 • S 1 h0Wn - by Current job in cumbents) can for the 
most part be achieved by familiarization training under direct corrective 

fSSUflT 1! ? U1te Sh ? rt time Peri0ds for most j° b tasks - There are no 
ind cations that comprehensive retraining for all rating tasks such as 

X? U 1 ? K 1d n 1" % f0rm i al SCh ? 01 ^ ettin9 (e " 9 - ^ school ), i s needed! 
At worst case instructional modules for training prospective AT returnees 

miVJKl ♦l n fj ndul1 . ******* be squired. Information not readily 
Sl liJi J" pr ? JeC ! S l aff iS needed ' however - for fi ™ decisions about 
? pl ne S JSLA? 1 " 1 " 9 t0 * bnng Proactive IRR returnees to an acceptable 
JSHJL 9 Ih^ enCy ^° r t0 - ™ inta . in their skills at a defined level. We 
recommend that the information provided by this report be 

VrZOaai /Va ^ dated a9ainSt 4 number of other considerations. Resource 
sponsors would be appropriate to validate training needs. 

Data Review 

As noted previously, the conclusions generated by the Droiect staff are 
considered tentative and subject to verification. GeneralK ons from th e 

? a LUT, a nl S ° h been lim i ted because of the sma11 numb ^s of ^questionnaires 
returned and because of suspected irr data base inadequacies. It is 

iill? e J'- however '. that nifch useful information can be gleanad from the 
descriptive summaries provided. Most of this information his not previous?? 
been available because of the many difficulties inherent in coSducK ski l 
deterioration research and restrictions on methods that can £ ! usee I because 

U n P nw a l C a a i,hi°r Sld c er - atl0n 5- Maximum «Plo1tat1on of the information that 
is now available 1S in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made bv indivi duals 

? e ^Tr'a^ ° f teChniCal requirements of the AT r ? n 

The NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to 
be considered in the review/validation process are discussed next. 

Review Areas 

« , ?0 S °c r * tljdy ' SHE* from the Aviation Electronics Technician School 
Se^aooJoor^frfn* *? ™' 1dentified the j° b task * ^ thiSJht Jj! d 
aaree PP oS P thf u[? T™ 1 " 9 IRR AT members to perform ' 0ther SMEs may not 
?he lob tasks tL In 50 ^ 6 SP ° nSOrS / Sh0Uld determi "e if these are indeed 
0 h L J rffl US c ,l hat an IRR ^turnee (at mobilization) should be able to 
perform Further, a companion decision is required concerning the 
acceptability of the reported level of competency. Sine active duty 
Z r n d e a t/ eP fi r Lt that , they ' 0n the average ' now Perform at these ieve?s! 
Utile less orofirw 6 : 10 " ^ource sponsors should conside 

rSnuirLnVc , nCy ."P" be acceptable. If so, attendant training 
requirements for IRRs with concomittant resource requirements would be 
lessened. On judging the need for training, task criticality in terms of 

EXE? 1 ° r e H qUipment Safety as U interacts with re ent changes to 
material, procedures, or equipment, muit also be considered. tnan 9 es t0 
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An additional decision factor concerns plans for utilization of IRR 
personnel at mobilisation. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Furtrar, while decisions must still be made concerning formal 
training, either institutional or via OJT, our belief is that this type of 
training can be limited. 

Finally, oased on (1) the IRR members' reports of their current 
relatively high residual levels of proficiency and (2) literature findings 
that maximum skill loss occurs after about 1 year of nonuse of sKi Us, it 
appears that skill maintenance training for ATs is not strictly necessary. 
Again, however, this conclusion must be weighed against planned utilization 
of recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of tne AT IRR 
manpower pool may be smaller than believed. Approximately 9 to 10 percent 
of the pool may not be contactable by mail. An additional segment of 
unknown size may have already reen listed and/or not be useful to the Navy 
for other reasons. A substantial percentage of ATs listed in IRR files 
could also be beyond the zone of involuntary recall. 

2. AT IRR personnel who work in civilian occupations related to their 
rating reported less deterioration of skills than ATs who are not similarly 
employed. This group should be considered for first recall priority. 

3. Comprehensive retraining and maintenance training for IRR ATs 
appear to be unnecessary to support mobilization. Familiarization training 
at recall consisting of supervised practice may suffice. This conclusion is 
subject to concurrence by subject matter expert ATs. 

4. AT personnel off active duty for greater than 3 years may require 
training on selected tasks to update skills despite their reported 
continuing high proficiency levels. 

5. Of the 18 AT job tasks for which skill deterioration was assessed, 
indications are that none will require any concerted training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 
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6. For all AT IRRs, mean values of current proficiency reported 
compare favorably with those reported by active duty personnel. This 
finding also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all t;mes. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall. 

3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
school house SMEs adequately represent the AT-3 job. Determine that the AT-3 
job is, in fact, acceptable as the target performance level for training to 
support mobilization. Request resource sponsors consider the data of this 
study against factors such as changes to materials, procedures, equipment 
used by the rating, critical ity of task performance, and mobilization plans 
for IRR personnel. K 

4. Consider recalling a sample of AT IRRs to assess their knowledge 
of current AT-3 job requirements. Use this information to validate the data 
and conclusions of this study. 
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ANNEX 2 



BUILDER (BU): 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Builder (BU) rating 
was one of these 16. 



PURPOSE OF THE STUDY 



The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 



APPROACH 



Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Four senior 
enlisted BUs, assigned to the Naval Construction Center, Gulf port, MS, 
served as subject matter experts (SME) for questionnaire development. Under 
guidance given by the project staff, the BU SMEs selected from various 
source materials a set of job ' tasks that, in their judgment, best 
represented the job (non-NEC specific) of an active duty BU-3. This level 
was chosen in the beUef that a recalled ready reservist who could perform 
job tasks competently at the E-4 level would make a positive work 
contribution to a receiving unit. 
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The BU-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job tesk at the End of Active Obligated Service (EAOS) 
and at the present time (NOW) . The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty BU-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty BU-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. They also set an upper 
limit on the proficiency levels that training must achieve to maintain at or 
restore skills to acceptable levels. Copies of these data collection 
instruments are shown in the next section. 

As of 25 September 1984, 459 BUs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN) . Questionnaires were mailed on 22 
October 1984 under CNO (OP- 11) cover letter to a random sample of 350 (76 
percent). Because of a low initial return rate, a follow-up mailing (351) 
was made on 29 January 1985. Questionnaire returns were accepted until 28 
February 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT) , and 
within CNO (OP-01) was accomplished for authorization to survey active duty 
BU-3 personnel. A BU-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 546, a sample of 292 BU-3s was 
determined using accepted survey research methods. Questionnaires were 
mailed on 18 September 1985 under CNO (OP-11) cover letter to unit/activity 
commanding officers for distribution to BU-3s named. Returns were accepted 
until 31 December 1985. Returned questionnaires were scanned to determine 
data usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of BU skill deterioration are 
presented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table 0-2-1 shows, for both the IRR and active duty BUs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
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sample, the number/percent of nonvalid returns (nonval id principally because 
of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (126) by the number delivered (i.e., 350 - 54 = 
296). 

Table D-2-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable Returns 
No. % 


Nonval id 
No. % 


IRR 


350 


126 


43 


54 15 


Active Duty 


292 


163 


56 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-2-2 for IRR personnel and in table D-2-3 for active duty personnel. 
The tables are modified questionnaire forms. 

Background Questions 

Of 121 IRR BUs answering the question, 85 (approximately 70 percent) 
reported that they now work in a civilian occupation related to their Navy 
BU rating. Answers to the remaining two background questions for IRRs (see 
table D-2-2) are not reported since it was determined that the answers might 
be redundant and could not be unambiguously interpreted. Of the active duty 
respondents answering the background questions (see table D-2-3), 144 of 158 
(91 percent) work in rating. One hundred and three (66 percent) are 
assigned shore duty. 

Task Performance Data 

The data summary tables (D-2-2 and D-2-3) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
"l.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of data (r = .862, p< .05) 
indicated significant agreement between the two classes of respondents. 
Thus, tasks which have not been performed frequently by active duty BUs (to 
date) are the same tasks that had not been performed frequently by IRRs at 
EAOS • 

Tables D-2-2 and D-2-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
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Table D-2-2 

Overall Summary of BU IRR Questionnaire Data 



PAST 1: 



ABSWER KEY: 



1. If necessary, cornet your Service 
Bunber. 

2. Is the work Which you do KM related 
to your levy ratlngf 

Yes B Bo 36 

3. Have you done PStVlOUS work which is 
related to your Bavy rating 

sinca your Expiration of Actlva 
Obligated Service (EAOS)T 

Yaa - Bo - 

4. Have you racaived training related to 
your Bavy rating sinca your Expiration 
of Active Obligated Service (EA08)t 

tas - Bo 



(1) Have never performed the task. 

(2) Can/could do slasUe parts of the task 
(need direct supervision) . 

(3) Can/could do most parts of the task 
(need general supervision) . 

(4) Can/could do all parts of the task 
(need only occasional supervision. 
Heats Rlnlaua local speed and accuracy 
standards.) 

(5) Can/could do complete task quickly and 
accurately (need no supervision). 



PAST 2: 



For each job task statement below: 

A. Indicate your CUBREBT level of ability according to the answer hay above. 

B. Estimate your PEEVIOUS level of ability at the time of your EAOS according to 
the answer hay above. 



"(1)" Choices A B 

Z * Taeke B Mean SO B Mean SD 

7 6.0 1. Bead and work from shop drawings 123 4.33 .928 117 3.89 1.216 
and sketches. 

13 11.1 2. Cut, bend, place, and tie 123 3.72 1.314 117 3.43 1.348 
reinforcing steel. 

10 8.7 3. Erect font aenbers, set screens, 122 4.01 1.168 lis 3.81 1.317 

strip for**, and shore excavations 

4. Perf ra layout and cut, fit and 
Install the following: 

1$ 12.9 a. Asphalt and vinyl floor coverings 122 4.24 1.143 116 3.91 1.368 

11 9.4 b. Sheet rock and Plywood wall 123 4.56 .951 117 4.27 1.255 

coverings. 

10 8.5 c. Door and window trln baseboards, 123 4.50 .995 117 4.15 1.270 

and sk> '.dings • 

10 8.7 d. Plywood, sheetrock anC suspended m 4.49 .976 115 4.11 1.269 

ceilings. 
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Table 0-2-2 (Continued) 



• 



10 


8.5 


5. 


Mix, placa, finish, and eura 


122 


4.20 


1.042 


117 


3.93 


1.271 








cone rata. 














20 


17.1 


6. 


Construct nasonry itructurai. 


1 91 


1 Aft 
J .So 


1 90^ 


117 


1 1C 
J ■ 


1.410 


9 


7.8 


7. 


Construct light wood fraaa 


122 


4.39 


1.025 


115 


4.13 


1.239 








■tructuraa including oparatlon of 




















trallarnaountad radial an f laid saw. 














18 


15.4 


8. 


Hava knowladga of tlabar itructurai 


123 


3.04 


1.308 


117 


2.96 


1.228 








(brldgaa, towars, haavlar structural) . 














23 


19.7 


9. 


Hava knowladga of advancad baaa 


123 


3.13 


1.396 


117 


2.89 


1.357 






structuras and praaarvativa appli- 




















cations against daeay (craosots. 




















panatravant, ate). 














17 


14.5 


10. Mix nwtar/stucco by hand or gas- 


123 


4.02 


1.270 


117 


3.72 


1.417 








drlvan porUbla nixar. 














20 


17.2 


IX. tract Mttl buildings. 


122 


3.49 


1.248 


116 


3.27 


1.321 


19 


17.0 


12. Knowladga of /apply knowladga to 


112 


3.60 


1.188 


106 


3.22 


1,'»24 








built-up sjatariala. 


















13. Oparata and parform praitart chacka 




















and oparator*s nalntananca on: 














22 


19.3 




a. Dlasal/gas drlvan air compressors. 


120 


3.45 


1.454 


114 


3.36 


1.470 


IS 


17.1 




b. Dlasal/gaa drlvan portabla 


117 


3.58 


1.452 


111 


3.48 


1.495 








t soars tors . 














23 


20.5 




c. Watar punps. 


118 


3.42 


1.493 


112 


3.30 


1.511 


9 


7.9 




d. Tabic las. 


121 


4.05 


1.277 


114 


3.94 


1.326 


13 


11.4 


14. 


Bract prafabrlcatad scaffolding 


122 


4.33 


1.117 


114 


4.09 


1.334 








and cQ—on typas of natal 




















scaf folding.* 














91 




15. 


Uia and cart for wirs ropa and 


121 


3.28 


1.416 


114 


3.18 


1.416 








f lbar Una. 


















16. 


Familiar with: 














16 


13.9 




a. Araaa of ractanglas, polygons. 


120 


3.62 


1.427 


115 


3.48 


1.477 








and c lrc las. 














14 


12.0 




b. Voluw of cubas and cyllndara. 


122 


3.71 


1.364 


117 


3.50 


1.448 


7 


6.0 




c. Board faat. 


122 


4.23 


1.112 


116 


3.98 


1.258 


13 


11.7 




d. U.S. walghts and naaauras and 


118 


3.77 


1.297 


111 


3.56 


1.340 








tha natric systsn. 














10 


8.7 


17. 


Maintain and rapair wood, masonry. 


120 


4.29 


1.095 


115 


4.03 


1.239 








and astal structuras. 


















18. 


Farfora as a crswnanbar on: 














53 


45.3 




a. a rapid runway rapair craw (SATS). 


122 


2.65 


1.542 


117 


2.50 


1.535 


45 


34.4 




b. a logging and sawmill craw. 


122 


2.74 


1.509 


117 


2.51 


1.460 


48 


41.7 




c. a piladrivlng craw. 


120 


2.52 


1.384 


115 


2.40 


1.401 


53 


45.7 




d. a waka front construction craw 


122 


2.43 


1.396 


116 


2.30 


1.409 



(piladrivlng, cofferdam* ( 
casaawmts) . 
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Table D-2-3 

Overall Summary of BU Active Duty Questionnaire Data 



PART 1: 

1. If neceeeary, cornet your Sorvlco 



2. Doee your eurront billot require you 
to work in your Bavy rat ins? 

TOO 144 Bo 14 

3. What typo duty Is your eurront 
billot? 

See 34 Shore 103 



AHSWEB KEY: 



(1) Have never performed the took. 

(2) Can/could do eisple parte of the teak 
(need direct supervision) * 

(3) Can/could do ewst parts of the teak 
(need general supervision) . 

(4) Can/ could do all parte of the teak 
(need only occasional supervision. 
Meets alniaun local speed and accuracy 
standards.) 

(5) Can/could do coaplete task quickly and 
accuretely (need no supervision). 



PART 2: 

Por each job teak eteteawnt below: 

A. Use the answer key above to Indicate your CUBBER level of ability. 

B. use the answer key above to estiaete your E XP ECT E D level of ability after 2 
years of qo£ performing these tasks* 



"(1)" Choices 

E % 

2 1.2 1 



Tasks 

Bead and work fro* shop drawings 
and sketches. 



13 8.0 2. Cut, bend, place, and tie 
reinforcing eteel. 

5 3.1 3. Erect fore aeaberi, eet screens, 

etrlp fores, end shore excavations 

4. Perform layout and cut, fit and 
install the following: 
9 5.5 a. Asphalt and vinyl floor coverings 

3 l.i b. gheetrock and plywood wall 

cover Inge* 

2 1.2 c. Door and window trim baseboards, 

and mold Inge. 

3 1.0 d. Plywood, sheet rock and suspended 

ceilings* 





A 






B 


V 


Mean 


SD 


B 


Mean 


1(2 


4.00 


.899 


153 


3.67 


163 


3.80 


1.213 


154 


3.52 


lei 


4.00 


1.031 


151 


3.57 


163 
163 


4.09 
4.55 


1.110 
.802 


153 
153 


3.83 
4.22 


163 


4.36 


.823 


153 


4.05 


162 


4.29 


.930 


152 


4.00 



SD 
.973 



.947 



102 °' 2 ' 8 
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Table D-2-3 (Continued) 



1 

3 


1.9 


5. 


Mix, place, finish, and euro 


183 


4.38 


.890 


153 


3.99 


1.082 








concrete. 














7 


4.3 


8. 


Construct masonry structures. 


183 


3.81 


1.021 


152 


3.19 


1.132 


12 


7.4 


7. 


Construct light wood frame 


183 


3.82 


1.149 


154 


3.58 


1.215 








structurss including opo ration of 




















trallor mounted radial an f laid taw. 
















ZZ .4 


8. 


Have knowledge of t labor structurss 


181 


2 .85 


1.200 


155 


2.47 


1.130 








(bridge*, towers, heavier structures) . 














31 


If .3 


9. 


Have knowledge of advanced base 


181 


9 a* 


1 911 


uj 


9 HI 


L . It/ 








structures and preservative appli- 




















cations against decay (creosote, 




















penetravont, etc.). 














5 


3.1 


10. 


Mix Bjortar/etucco by hand or gas- 


182 


4.21 


as 7 


153 


% at 

J • Of 


1.138 








driven portable mixer. 














24 


15.0 


11. 


tract mUI buildings. 


180 


3.12 


1.27C 


154 


2.93 


1.237 


20 


12.6 


12* Knowledge of /apply knowledge to 


159 


2.97 


1.139 


149 


2.71 


1.141 








built-up natsrUls. 


















13. 


Operate and perform pros tart checks 




















and operator's maintenance on: 














18 


11.0 




a. Diesel/ges driven air compressors. 


183 


3.88 


1.320 


155 


3.41 


1.323 


13 


9.0 




b. Diesel/gas driven portable 


182 


3.70 


1.286 


154 


3.42 


1.322 








generators . 














37 


22.8 




c. water pumps. 


182 


3.28 


1.541 


154 


3.14 


1.504 


3 


1.8 




d. Vehicles. 


182 


4.43 


.944 


152 


4.19 


1.108 


2 


1.2 


14. tract prefabricated scaffolding 


182 


4.44 


.877 


155 


4.19 


1.012 



and consjon types of natal 
scaffolding* 

40 24.8 15. Use and care for wire rope and 181 2.92 1.401 153 2.79 1.331 

fiber line. 

18. Fsmillar with: 

9 5.8 a. Areas of rectangles, polygons, 182 3.51 1.133 155 3.18 1.261 

and circles. 

9 5.5 b. Volume 0 f cubes and cylinders. 181 3.52 1.173 158 3.17 1.258 

2 1.2 c. Board feat, 183 4.30 .904 154 3.92 1.094 

• 4.9 d. 0.8. weights and nsasures and 183 3.44 1.117 154 3.12 1.184 

the metric system. 

7 4.3 17. Maintain and repeir wood, masonry, 181 4.12 .878 153 3.78 1.028 
and metal structures. 



18. Perform as a c remember on: 

48.4 a. a rapid runway repair craw (SATS). 181 2.34 1.504 153 2.18 1.325 

83 51.8 b. a logging and sawmill crew. 181 2.20 1.409 153 2.20 1.372 

96 60.0 c. e pi led riving crew. 160 1.81 1.141 152 1.82 1.124 

108 67.1 d. a wakefront construction crew 161 1.63 1.017 153 1.72 1.985 
(plledrlvlng, cofferdams, 
easements). 
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standard deviation (SU) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR sample, table D-2-2, the "A M column 
reflects current average ability level; the "B" column, EAOS average ability 
level. For the active duty sample (table 9-2-3), the "A" column refers to 
current (NOW) ability and the "B" to proficiency expected after 2 years of 
nonperformance of a task.l A Pearson Product Moment Correlation (r = .959, 
p < .05) computed between task means for IRR EAOS and active "duty NOW 
(current proficiency) values indicates that the IRR members, while on active 
duty, performed job tasks at competency levels equivalent to those of 
current job incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the BU-3 job in its entirety (as reflected by the tasks used) 
the average BU IRR member feels that he could now perform tasks of the 
rating at a level where only occasional supervision would be needed (mean = 
3.8). 

For the active duty group, means reflecting proficiency on each job 
task for BUs working/not working in their rating were computed. These are 
shown in table D-2-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-2-5 displays task proficiency means for two subgroups of the BU 
IRR respondents: (1) those who answered that they were now working , "W," in 
a field related to the Navy BU rating and (2) those who indicated that they 
were not working in a related field ( M N M ). Both EAOS and NOW (current) 
proficiency means are given. These means, as well as those in table D-2-4, 
were computed from choices of 2, 3, 4, or 5 from the answer key. These 
choices piace proficiency along a continuum from "Need direct supervision" 
through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-2-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 
membership: current proficiency is less than EAOS proficiency. Values with 
no signs indicate increases in proficiency. 

The table shows that BUs who now work ("W") in a field related to their 
former active duty jobs gained proficiency on 28 of the 30 job tasks. The 
"N" subgroup lost proficiency on 19 of the 30 tasks and had small gains on 
the other 11. Statistical tests (t tests for independent means; see 
Guilford and Fruchter, 1973) indicated that over all task? of the rating, 
proficiency of the two subgroups was equivalent at EAOS (t * 1.16, p<.252). 
Task mean proficiency values, however, differed significantly (t = 2.97, 
£<.002) for current (NOW) proficiency. 



^These expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since it was clear that many respondents did not 
understand the question being asked. 
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Table 0-2-4 

Task Mean Values for Two Subgroups of Active Duty BUs 



Not Working ("N'T Working ("W'T 

Task NOW EXP NOW EXP 



1 


4.231 


3.643 




4.028 


3.714 


2 


4.417 


3.538 




4.023 


3.738 


3 


4.308 


3.692 




4.072 


3.701 


4A 


4.273 


3.917 




4.268 


3.977 


4B 


4.429 


4.308 




4.631 


4.278 


4C 


4.143 


4.077 




4.423 


4.098 


4D 


4.286 


4.077 




4.350 


4.023 


5 


4.231 


3.923 




4.465 


4.083 


t> 


4.000 


3.615 




3.686 


3.294 


7 


4.143 


4.000 




4.023 


3.693 


8 


3.600 


3.182 




3.100 


2.860 


9 


3.455 


3.333 




3.289 


3.000 


10 


4.286 


4.231 




4.297 


3.916 


11 


3.727 


3.417 




3.583 


3.241 


12 


3.500 


3.636 




3.218 


2.895 


13A 

x 


4.0/1 


3.923 




3.984 


3.648 


13B 


4.143 


4.000 




3.908 


3.610 


13C 


4.214 


4.154 




3.925 


3.607 


13D 


4.500 


4.500 




4.479 


4.242 


14 


4.429 


4.000 




4.489 


4.252 


15 


3.800 


3.500 




3.519 


3.264 


16A 


3.643 


3.308 




3.642 


3.387 


16B 


3.714 


3.303 




3.654 


3.357 


16C 


4.214 


3.714 




4.345 


3.985 


16D 


3.643 


3.538 




3.551 


3.298 


17 


4.286 


4.000 




4.099 


3.778 


18A 


3.875 


3.625 




3.592 


3.013 


18B 


4.000 


3.714 




3.403 


3.219 


18C 


3.800 


3.143 




3.000 


2.814 


18D 


3.600 


3.333 




2.870 


2.774 




Composite Mean: 


Group W 


NOW 


3.864 










EXP 


3.559 








Group N 


NOW 


4.032 










EXP 


3.745 






Overall Mean: 




NOW 


3.948 





EXP 3.652 



In = 14 
2n = 144 
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Table D-2-5 

Task Mean Values for Two Subgroups of IRR BUs 





Not Working ("N") 1 


Working ("W") 2 


Mean Difference 


Task 


NOW 


EAOS 


NOW 


EAOS 


"N" 


"W" 


1 


O • OoO 


0 • 500 


A Rt;9 
4. 003 


A 1 9Q 
4. ico 


H HA7 
-U .U4/ 


H A9Q 
U. HtD 


2 


O • 010 


0 • 0 / j 


a °nn 

4. lUU 


^ 877 
O • 0/ / 


-u . uoo 


n 9.90 
U. oco 


3 


^ RAR 

0 • OHO 


^ aft? 


4 • 010 


A 1 
4. 10D 


n 91 7 

-U • 01 / 


n 1 7Q 
U. 1/0 


4A 


a nnn 
4 .uuu 


A 9AQ 
4. £0:7 


A CI Q 

4. bio 


A 9.7H 
4. 0/U 


n o£\i 
-u .£t>y 


n 1/10 


4B 


4 • Doi 


A £A9 
4. C40 


A 7QA 
*K /ou 


A coo 


n 119 
-U. ll£ 


n 1 n/i 
U. 194 


4C 


A AAQ 
4 • 40:7 


4. D00 


A 71 A 
4 . / 14 


A A 1 
4 • 410 


n nc7 
-U.Uo/ 


n ooo 

u. ^yo 


4D 


A 

4 • O / 0 


A Rl Q 
4 • DI5 


A AQQ 
4 • Or? 


A 9£G 
**. OOO 


n l a a 

-U . 144 


n Qoi 
U. 001 


5 


a nnn 


4 . £/U 


A ^81 
4. 001 


A 1 71 
4.1/1 


n 97c 

-U. L /0 


n 91 n 


6 


^ AAA 
O • 404 


9* 

0 . OoD 


^ pi n 

0 • olU 


9* AC9 
0. 0b£ 




n 1 no 
U. ibo 


7 


A 1 A7 
4. 14/ 


A 9A7 
^.00/ 


A CCQ 


a /inc 
**• 4Ub 


n oon 
-U.££U 


n o c/i 
U.2b4 


8 


9 QCO 
£.300 


o ncn 

o. Uoy 


3.560 


O Ort"7 

0.397 


n i nc 

-0. 106 


0. 163 


9 


o non 
0.U8U 


o.QQQ 


0.0/5 


O /I/IO 

3.443 


0.080 


0.232 


10 




A OOO 


4.£/b 


4.155 


n i n i 

-0.101 


0. 120 


11 


0. 00/ 


o 7on 
3.1 d\) 


o 7nn 

o. /9Q 


o "7 on 

o. /o9 


n rtc 0 

-0.053 


0.051 


12 


0 coo 

o. boo 


o £ on 
0.08U 


0.91/ 


o c c c 

0.656 


n i a n 

-0. 147 


0.261 


13A 


o. /bU 


9 Q7 R 
0 . O/ J 


a nnn 


o non 


n iQc 
-U. l£b 


0.061 


13B 


o • OoU 


0. 71/ 


A 107 
4. 10/ 


a ni c 
Q.Uib 


n 90 7 
-U.£o/ 


n i 00 

0. 122 


13C 


3.667 


3.810 


3.945 


3.909 


-0.143 


0.036 


130 


a a nn 


a oi n 


4. £0£ 


a i /in 

4. 149 


0.090 


0. 113 


14 


4.323 


4.480 


4.598 


4.473 


-0.157 


0.125 


15 


9 OOO 
0. 050 


0 K99 

im Odd 


0 701 

o. /81 


0.7U6 


n i on 

-0. 129 


0.075 


16A 


O no c 

o. 885 


o ncl 

3.957 


3.962 


o no* 

3.824 


-0.072 


0.138 


16B 


o nno 

o.yuo 


O "7 "7 O 

3.77o 


O A/in 

3.949 


3.824 


r\ ion 

0. 125 


0. 125 


16C 


4.323 


4.069 


4.369 


4.192 


0.254 


0.177 


160 


4.310 


3.893 


3.987 


3.884 


0.417 


0.103 


17 


A 9GQ 

£bo 


A 9A1 
4 • £41 


a cnn 


A 11Q 


ft nil 

U.Ui/ 


U. 152 


18A 


3.684 


3.625 


3.788 


3.783 


0.059 


0.005 


183 


3.250 


3.091 


3.800 


3.592 


0.159 


0.208 


18C 


2.947 


2.938 


3.491 


3.520 


0.009 


-0.029 


18D 


2.944 


2.929 


3.473 


3.500 


0.015 


-0.027 






Composite Mean: 


Group W 


NOW 4.130 














EOS 3.972 












Group N 


NOW 3.794 














EOS 3.843 










Overall Mean: 




NOW 3.962 







EOS 3.907 



In 
2n 



36 
85 



9 
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TINE IN IRR 

Table D-2-6 provides a breakdown of BU personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
IRRs off active duty more than 3 years. These mean values are shown for 
information only, since the number of individuals in most time groups is too 
small to permit meaningful quantitative interpretation. 

Table D-2-6 

Mean Proficiency Values for BU IRR Respondents by Time Since EAOS 



Time (Mos.) 

Since EAOS Mean No. of Cases 



0-5 


3.45 


23 


6-11 


3.48 


4 


12-17 


3.73 


2 


18-23 


3.69 


1 


24-35 


3.76 


1 


36+ 


3.99 


55 


Overall Mean 


3.80 


86* 



*EA0S dates were not contained on the NAVMILPERSCOM data file for a 
large number of IRR BUs. Consequently, time since EAOS could not be 
determined. 



COMMENTS AND OBSERVATIONS 

Comments and observations on the cuta are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are baseo on best available data. However, they are 
subject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 
previously. They also suggest directions that should be taken with respect 
to the management and utilization of the IRR resource. 
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COMMENTS ON DATA BASE 

Approximately 15 percent of questionnaires returned were classified as 
"nonvalid" (table D-2-1). This category reflects probable errors in the IRR 
data base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from another 
service, was never on active duty in the Navy." (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 1985). Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased." From the above data, it can be concluded that about 15 
percerlt of the BU IRRs could not or would not be available for a 
mobilization call. 

Questionnaires were presumably delivered by the Postal Service to a 
number of BUs (57 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above—they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the BU 
IRR roster. 

Another data base issue that should be exciiined concerns the amount of 
time that BU respondents have been away from active duty. This information 
is given in table D-2-6. Sixty-four percent were in the IRR for more than 3 
years. Two issues emerge: (1) the need for skill upgrading and (2) 
availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group despite their beliefs 
(table D-2-6) in their continuing ability to perform job tasks at an 
acceptable level. 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-2-5. In table D-2-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 
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Approximately 70 percent of BU IRRs reported that they now worlc in a 
civilian occupation related to their BU rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-2-5 
shows, BUs who now work, M W, M in a field related to their Navy rating gained 
proficiency on 28 of 30 job tasks. The "N" subgroup lost proficiency on 19 
job tasks and reported small gains on the other 11. Taken over all tasks, 
differences between the current (NOW) proficiency means for the two 
subgroups were statistically significant. Also, they could not be 
attributed to initial differences between the groups at £A0S. Thus, 
civilian BU-related employment significantly affected skill deterioration. 
Those continuing to work in the field after EAOS reported insignificant 
deterioration and a high amount of proficiency increase. The tasks on which 
skill deterioration occurred are easily identifiable from table D-2-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the 
implications of skill deterioration data must be assessed against the 
criterion of acceptable level of proficiency. This can be done most 
directly by comparing the current proriciency levels eported by BU IRRs 
against the levels reported by active duty BU-3s. The task means for the 
active duty sample can be taken as E-4 criterion performance since they 
reflect the level of proficiency claimed by the average BU-3 now on active 
duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either table D-2-2 or D-2-3. The answer key shows that a value of 
M 4," for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
M 4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
proficiency category. Skill loss occurred on tasks 3 and 5, for example, 
for the IRRs not working in a related field. However, the losses reported 
resulted in the IRRs remaining in the "4" category (see table D-2-5). We 
would conclude that the deterioration is of no consequence insofar as 
signaling a need for retraining. 

Assessment of the need for training IRR personnel to support 
mobilization should proceed with the application of similar logic. Table 
D-2-7 below presents the task mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the BU rating and 
also for those who are working in a related field. These values ere from 
table D-2-5. Task proficiency means for active duty personnel working in 
their rating (taken from table D-2-4) are also shown in table D-2-7. 
Inspection of the data shows that only one value, marked with an asterisk in 
the table, deviates markedly from the active duty norm. Hence, from these 
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data alone, a fair conclusion is that training of BU IRRs would not be 
required before mobilization to bring proficiency to an acceptable level. 

Table D-2-7 

Task Mean Proficiency Values for IRR and Active duty BUs 





IRR 




Active Dutv 


Tasks 


Not ir Field 


In Field 


In Rating 


1 


3.9 


4.6 


4 0 


2 


3.3* 


4.2 


4 0 


3 


3.5 


4.3 


4 1 


4a 


4.0 


4.5 


4 3 
*t • j 


4b 


4.5 


4 8 


4 fi 


4c 


4.5 


4 7 


4 4 


4d 


4.4 


4 7 


4 4 


5 


4.0 


4 4 


4 c: 


6 


3.5 


3 ft 


1 7 
0 • / 


7 


4.1 


4 7 


a n 


8 


3.0 


3 fi 


^ l 
j . i 


9 


3.1 


3 7 


0*0 


10 


4.1 


4 3 


4 T 


11 


3.7 


3 ft 


0 • 0 


12 


3.5 


3 9 


0 • £ 


13a 


3.8 


4.0 


4.0 


13b 


3.7 


4.1 


3.9 


13c 


3.7 


3.9 


3.9 


13d 


4.4 


4.3 


4.5 


14 


4.3 


4.6 


4.5 


15 


3.4 


3.8 


3.S 


16a 


3.9 


4.0 


3.6 


16b 


3.9 


3.9 


3.7 


16c 


4.3 


4.4 


4.3 


16d 


4.3 


4.0 


3.6 


17 


4.3 


4.5 


4.1 


18a 


3.7 


3.8 


3.6 


18b 


3.3 


3.8 


3.4 


18c 


2.9 


3.5 


3.0 


18d 


2.9 


3.5 


2.9 



♦Probable training need. 



From our assessment, the current level of proficiency of BU IRRs on all 
but the one job task noted is probably adequate. There seems to be no need 
for extensive retraining or maintenance training prior to mobilization. The 
average IRR BU should be able to perform most of the required job tasks at 
an appropriate level of competency with a modicum of ^familiarization at 
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mobilization. For the most part, this could probably be given by close, 

corrective supervision while the returnee is performing job tasks. This 

conclusion pertains to all BUs but is probably especially relevant to the 70 
percent of IRR BUs who continue to work in a BU-related occupation. 

An additional factor to consider in assessing needs for training, 
however, concerns time since EAOS. Sixty-four percent of the 3U IRRs were 
away from active duty for more than 3 years (see table D-2-6). Subject 
matter experts who review the data provided here may determine that skill 
upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 



VALIDATION OF DATA 



Our analyses indicate that the need for training of BU IRRs against 
mobilization requirements is not great. It would appear that required 
proficiency (i.e., the level shown by current job incumbents) can for the 
most part be achieved by familiarization training under direct corrective 
supervision in quite short time periods for most job tasks. There are no 
indications that comprehensive training for all rating tasks, such as would 
be provided in a formal school setting (e.g., "A" School), is needed. 
Information not readily available to the project staff is needed, however, 
for firm decisions about the need for training to bring prospective IRR 
returnees to an acceptable level of proficiency or to maintain their skills 
at a defined level. We recommend that the information provided by this 
report be evaluated/validated against a number of other considerations. 
Resource sponsors would be appropriate to validate training needs. 



As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data are limited because of the small numbers of questionnaires returned and 
because of suspected IRR data base inadequacies. It is believed, however, 
that much useful information can be gleaned from the descriptive summaries 
provided. Most of this information has not previously been available 
because of thu many difficulties inherent in conducting skill deterioration 
research, and restrictions on methods that can be used because of practical 
considerations. Maximum exploitation of the information that is now 
available is in order. A complete and accurate assessment of the meaning 
and action implications of the data should be made by individuals who are 
thoroughly knowledgeable of technical requirements of the BU rating. The 
NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to be 
considered in the review/validation process are discussed next. 



Review Areas 



For our study, SMEs *rom the Naval Construction Center, Gulfport, MS, 
identified the job tasks they thought would be appropriate for returning IRR 
BU members to perform. Other SMEs may not agree on the list. Resource 
sponsors should determine if these are the job tasks that an IRR returnee 
(at mobilization) should be able to perform. Further, a companion decision 
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is required concerning the acceptability of the reported level of 
competency. Since active duty personnel report that they, on the average, 
now perform at these levels, these data reflect E-4 criterion performance. 
Resource sponsors should consider whether less proficiency would be 
acceptable. If so, attendant training requirements for IRRs with 
concomittant resource requirements would be lessened. On judging the need 
for training, task critical ity, in terms of personnel or equipment safety as 
it interacts with recent changes to material, procedures, or equipment, must 
also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Further, while decisions must still be made concerning formal 
training, either institution.il or via OJT, our belief is that this type of 
training can be limited. 

Finally, based on (1) the IRR members' reports of their current 
relatively high residual levels of proficiency and (2) literature findings 
that maximum skill loss occurs after about 1 year of nonuse of skills, it 
appears that skill maintenance training for BUs is not strictly necessary. 
Again, however, this conclusion must be weighed against planned utilization 
of recalled IRk members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the BU IRR 
manpower pool may be smaller than believed. Approximately 15 percent of the 
pool may not be contactable by mail. An additional segment of unknown size 
may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage of BUs listed in IRR files could also be 
beyond the zone of involuntary recall. 

2. BU IRR personnel who work in civilian occupations related to their 
rating reported no significant deterioration of skills. Rather, this 
subgroup gained proficiency on 28 of 30 joD tasks. Consequently, this 
subgroup should be considered for first recall priority. 

3. Retraining and maintenance training for IRR BUs appear to be 
unnecessary to support mobilization. Familiarization training at recall 
consisting of supervised practice may suffice. This conclusion is subject 
to concurrence by subject matter expert BUs. 
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4. BU personnel off active duty for greater than 3 years may require 
training on selected tasks to update skills if there have been substantial 
changes in building techniques despite their reported continuing high 
proficiency levels. Basic building skills probably do not require 
retraining. 

5. Of the 30 BU job tasks for which skill deterioration was assessed, 
indications are that none will require any concerted training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 

6. For all BU IRRs, mean values of current proficiency reported 
compare favorably with those reported by active duty personnel. This 
finding also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall . 

3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
schoolhouse SMEs adequately represent the BU-3 job. Determine that the BU-3 
job is, in fact, acceptable as the target performance level for training to 
support mobilization. Request resource sponsors consider the data of this 
study against factors such as changes to materials, procedures, equipment 
used by the rating, critical ity of task performance, and mobilization plans 
for IRR personnel. 

4. Consider recalling a sample of BU IRRs to assess their knowledge 
of current BU-3 job requirements. Use this information to validate the data 
and conclusions of this study. 
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CRYPTOLOGIC TECHNICIAN (ADMINISTRATION) (CTA) 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 




D-3-UM 



Technical Report 86-007 




INTRODUCTION 



Following a first-tour g* active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered, A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Cryptologic 
Technician (Administration) (CTA) rating was one of these 16. 



PURPOSE OF THE STUDY 



The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum acceptable proficiency. 

In a general sense, acceptaole proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 



APPROACH 



Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Five senior 
enlisted CTAs, assigned to the Naval Technical Training Center, Corry 
Station, Pensacola, FL, served as subject matter experts (SME) for 
questionnaire development. Under guidance given by the project staff, the 
CTA SMEs selected from various source materials a set of job tasks that, in 
their judgment, best represented the job (non-NEC specific) of an active 
duty CTA-3. This level was chosen in the belief that a recalled ready 
reservist who could perform CTA job tasks competently at the E-4 level would 
make a positi /e work contribution to a receiving unit. 
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The CTA-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks* 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty CTA-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty CTA-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. They also set an upper 
limit on the proficiency levels that training must achieve to maintain at or 
restore skills to acceptable levels. Copies of these data collection 
instruments are shown in the next section. 

As of 10 December 1984, 328 CTAs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN). Questionnaires were mailed on 8 
February 1985 under CNO (0P-11) cover letter to a random sample of 222 (67.7 
percent). Coordination with the Commander, Naval Security Group 
(COMNAVSECGRU) had previously been accomplished. Because of a low initial 
return rate, a follow-up mailing (136) was made on 8 April 1985. 
Questionnaire returns were accepted until 24 May 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), 
COMNAVSECGRU, and within CNO (0P-01) was accomplished for authorization to 
survey active duty CTA-3 personnel. A CTA-3 roster, current as of 2 August 
1985, was obtained from NAVMILPERSCOM. From a pool of 191, a sample of 159 
CTA-3s was determined using accepted survey research methods. 
Questionnaires were mailed on 18 September 1985 under CNO (0P-11) cover 
letter to unit/activity commanding officers for distribution to CTA-3s 
named. Returns were accepted until 31 December 1985. Returned 
questionnaires were scanned to determine data usability, and data were 
entered into computer files. Subsequently, summaries of the information of 
interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of CTA skill deterioration are 
presented in this section. 
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QUESTIONNAIRE RETURN STATISTICS 

Table D-3-1 shows, for both the IRR and active duty CTAs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid returns (nonvalid principally because 
of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (50) by the number delivered (i.e., 222 - 71 « 
151). 

Table D-3-1 



Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


222 


50 


33 


71 32 


Active Duty 


159 


117 


74 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-3-2 for IRR personnel and in table D-3-3 for active duty personnel. 
The tables are modified questionnaire forms. 

Background Questions 

Of 49 IRR CTAs answering the question, 11 (approximately 22 percent) 
reported that they now work in a civilian occupation related to their Navy 
CTA rating. Answers to the remaining two background questions for IRRs (see 
table D-3-2) are not reported since it was determined that the answers might 
be redundant and could not be unambiguously interpreted. Of the active duty 
respondents answering the background questions (see table D-3-3), 99 of 114 
(86.8 percent) work in rating. One hundred and six (94 percent) are 
assigned sea duty. 

Task Performance Data 

The data summary tables (D-3-2 and D-3-3) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
"1.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank -order correlation (see 
Siegel, 1956) computed between the two sets of data (r * .924, p< .05) 
indicated significant agreement between the two classes of respondents. 
Thus, tasks which have not been performed by active duty CTAs (to date) are 
the same tasks that had not been performed by IRRs at EAOS. 
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Table D-3-2 

Overall Summary of CTA IRR Questionnaire Data 



PAST 1: 



AMSWIft KEY: 



If necessary, correct your Service 
lumber. 

Is the work Which you do MOW releted 
to jour lavy rat ins? 

Tee 11 Bo 38 

Have you don* PREVIOUS work Which Is 
related to jour lavy rating 
sine* jour Expiration of Active 
Obligated Service (EAOS)T 

Yaa - So - 

Have you racaivad training related to 
jour lavy rating since jour Expiration 
of Active Obligated Service (EAOS)T 
tea - to - 



(1) Have never performed the taak. 

(2) Can /could do simple parts of the task 
(need direct supervision). 

(3) Can/could do most parts of the task 
(need general supervision) . 

(4) Can/could do all parte of the taak 
(need only occasional supervision. 
Meets minimum local speed and accuracy 
standards . ) 

(5) C*n/ could do complete task quickly and 
accurately (need no supervision). 



PAST 2: 



For each jot task statement below: 

A. Indicate your CUtftfiVT level of ability according to the answer key above. 

B. Estimate your PREVIOUS level of ability at the time of your EAOS according to 
the answer key above. 





Choices 






A 






B 




E 


% 




Tasks 


■ 


Mean 


SD 


V 


Mean 


SD 






1. 


Type messages, correspondence* 
directives t and operational 
records and reports according 
to current directives. 


49 


3.49 


1.227 


50 


4.68 


.683 


i 


2.0 


2. 


Perform filing clerk duties. 


49 


4.0? 


1.331 


50 


4.66 


.872 






3. 


Operate office equipment. 


49 


4.16 


1.179 


50 


4.80 


.639 


i 


2.0 


4. 


Use and interpret publications 
pertaining to personnel security 
and general administration. 


49 


3.82 


1.219 


50 


4.54 


.813 


i 


2.0 


5. 


Enter changes to update publications 
pertaining to personnel, security* 
and general administration. 


48 


4.02 


1.246 


49 


4.65 


.830 


i 


2.0 


6. 


Account for, handle, stow, transmit, 


48 


3.52 


1.337 


50 


4.50 


.863 



protect and destroy clasalf led 
material (all types including 81). 
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Table D-3-2 (Continued) 



14.6 7. parfom SSO adalniatration functions. 46 3.00 1.535 4$ 3.88 1.424 

4.0 8. Perform official and raglstarad mall 49 3.55 1.355 50 4 42 1 032 
yaoaan dutlaa; prapara nUrUl for 
Amad Forcaa Courlar Sarvlca 
transmittal. 

8.0 t. Oparata and understand tha capa- 49 3.08 1.644 50 3 04 1 761 
bilitiaa of word processing 
aquipaaat. 

10. X can/could type. 43 SOupm 78.439 46 64wp«i 52.714 



Ova rail Mean: 3.62 



# 



• 
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Table D-3-3 

Overall Summary of CTA Active Duty Questionnaire Oata 



PAST 1. 



1. If necessary, correct your Service 
Mir. 

2. Does your current billet require you 
to work in your l*vy rating? 

Tee 99 No 13 

3. Whet type duty in your current 
billett 

See 106 shore ]_ 



AISVER KEY: 

Have never perforated the task. 



(1) 
(2) 

(3) 



Can/could do simple parts of the task 
(need direct supervision). 

Can/could do moat parts of the task 
(need general supervision). 

(4) Can/could do all parts of the task 
(need only occasional supervision. 
Meets minimum local speed and accuracy 
standards . ) 

(5) Can/could do complete task quickly and 
accurately (need no supervision) . 



PAST 2: 

Por esch job task statement below: 

A. Use the answer key above to Indicate your CUSRBR level of ability. 

B. use the answer key above to estimate your EXPECTED level of ability efter 2 
years of no£ per fo rains these tasks. 





Choices 






A 






B 




p 


% 




Tasks 


■ 


Mean 


SD 


V 


Mean 


SD 


2 


1.7 


1. 


Type messages, correspondence, 
directives, and operational 
records and reports accord ins 
to current directives. 


117 


4.16 


.830 


110 


3.54 


.955 


2 


1.7 


2. 


Perform filing clerk duties. 


116 


4.67 


.755 


110 


4.40 


.941 


2 


1.7 


3. 


Operate office equipment. 


116 


4.60 


.844 


110 


4.15 


1.012 


9 


7.8 


4. 


Use and interpret publications 
pertaining to personnel security 
and general administration. 


116 


3.86 


1.156 


110 


3.52 


1.163 


5 


4.3 


5. 


Enter changes to update publications 
pertaining to personnel* security, 
and general administration. 


116 


4.40 


1.087 


110 


4.06 


1.065 


5 


4.4 


6. 


Account for, handle, stow, tranemlt, 


114 


4.12 


1.074 


108 


3.54 


1.147 



material (all types including 81). 
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Table D-3-3 (Continued) 



42 34.2 7. Parfora 880 administration functions. 11* 2.75 1.520 113 2.31 1.289 

IS 12.9 8. Psrfora official and roftlstsrod nil 116 3.85 1.381 112 3.39 1.283 
fwwn duties; prepare aittritl for 
Araed Forces Courier Service 
transmittal. 

19 16.4 9. Operate and understand the cape- 116 3.62 1.449 110 3.31 1.347 

bllltles of word processing 
equipment. 

10. X can/could type. 
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Tables D-3-2 and D-3-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SD) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR sample, table D-3-2, the "A" column 
reflects current average ability level; the 11 B" column, EAOS average ability 
level. For the active duty sample (table D-3-3), the "A" column refers to 
current (NOW) ability and the "B" to proficiency expected after 2 years of 
nonperformance of a task.l A Pearson Product Moment Correlation (r = .57, 
p> .05) computed between task means for IRR EAOS and active duty NOW 
(current proficiency) values indicates that the IRR members, while on active 
duty, did not perform job tasks at competency levels equivalent to those of 
current job incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the CTA-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean = 3.62). 

For the active duty group, means reflecting proficiency on each job 
task for CTAs working/not working in their rating were computed. These are 
shown in table D-3-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-3-5 displays task proficiency means for two subgroups of the 
CTA IRR respondents: (1) those who answered that they were now working 
("W") in a field related to the Navy CTA rating and (2) those who indicated 
that they were not working ( M N M ) in a related field. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-3-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key. These choices place proficiency along a continuum from "Need direct 
supervision 11 through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-3-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 
membership: current proficiency is less than EAOS proficiency. Values with 
no signs indicate increases in proficiency. 

The table shows that CTAs who now work ("W") in a field related to 
their former active duty jobs gained proficiency on two of the nine job 
tasks. This group also reported less skill deterioration over the other 
rating tasks than the "N" subgroup. Statistical tests (t tests for 
independent means; see Guilford and Fruchter, 1973) indicated tfiat over all 
tasks of the CTA rating the proficiency of the two subgroups was equivalent 
at EAOS (t = 1.66, p<.0582). Task mean proficiency values differed 
significantly (t = 5.9B, £<. 0000096) on current (NOW) proficiency. 



*These expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since it was clear that many respondents did not 
understand the question being asked. 
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Table 0-3-4 

Task Mean Values for Two Subgroups of Active Duty CTAs 



Not Working ("N") Working ("W") 



Task 


NOW 


EXP 




NOW 


EXP 


i 
i 


4.UUU 








0 • D/O 


o 

L 




A 231 

*t • COL 




A 7QA 




3 


4.643 


3.857 




4.680 


4.231 


4 


3.909 


3.417 




4.106 


3.697 


D 


A 077 


0 CI c 
0.019 




A A/ 1 9 




6 


3.727 


3.200 




4.326 


3.698 


7 


4.000 


3.222 




3.742 


3.197 


8 


4.300 


3.538 




4.273 


3.711 


9 


3.583 


3.357 




4.205 


3.718 




Composite Mean: 


Group W 


NOW 


4.336 










EXP 


3.843 








Group N 


NOW 


4.090 










EXP 


3.570 






Overall Mean: 




NOW 


4.213 










EXP 


2.809 





In = 15 
2n = 99 
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Table D-3-5 

Task Mean Values for Two Subgroups of IRR CTAs 

Not Working ("N") 1 Working ("W") 2 Mean Difference 

Task NOW EAOS NOW EAOS "N" "W" 



1 


3.529 


4.641 


4.273 


4.818 


-1.112 


-0.545 


o 
L 


H. UOO 


4.684 


4.909 


4.y09 


-0.596 


0.000 


-J 
0 




4.769 


4.818 


A nnn 


-0.630 


-0.091 


4 


3.886 


4.632 


4.364 


4.545 


-0.746 


-0.181 


5 


4.057 


4.737 


4.800 


4.700 


-0.680 


0.100 


6 


3.529 


4.526 


4.500 


4.727 


-0.997 


-0.2°7 


7 


3.542 


4.333 


4.100 


4.455 


-0.791 


-0.355 


8 


3.500 


4.486 


4.636 


4.818 


-0.986 


-0.182 


9 


3.870 


4.227 


4.600 


4.444 


-0.357 


0.156 






Composite Mean: Group 


W NOW 


4.556 












EOS 


4.703 










Group 


N NOW 


3.793 












EOS 


4.559 








Overall 


Mean: 


NOW 


4.174 












EOS 


3.393 





in = 38 
2n = 11 
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TIME IN IRR 



Table D-3-6 provides a breakdown of CTA personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
IRRs off active duty more than 3 years* These mean values are shown for 
information only, since the number of individuals in each group is too small 
to permit meaningful quantitative interpretation* 



Table D-3-6 

Mean Proficiency Values for CTA IRR Respondents by Time Since EAOS 



Time (Mos.) 

Since EAOS Mean No. of Cases 



3.22 3 



3.22 1 



4.22 2 
3.63 40 
3.62 46 



0-5 

6-11 

12-17 

18-23 

24-35 

36+ 

Overall Mean 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rate coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
Inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 
previously. They also suggest directions that should be taken with respect 
to the management and utilization of the IRR resource. 
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COMMENTS ON DKTm BASE 

Approximately 32 percent of questionnaires returned were classified as 
"nonvalid" (table D-3-1). This category reflects probable errors in the IRR 
data base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undel i verable (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from another 
service, was never on active duty in the Navy." (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 1985.) Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased." From the above data, it can be concluded that about 
one-third of the CTA IRRs could not or would not be available for 
mobilization. 

Questionnaires were presumably delivered by the Postal Service to a 
number of CTAs (67 percent) from whom no information was received. It is 
likely that many <lid not respond for reasons such as those cited above— they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the CTA 
IRk roster. 

Another data base issue that should be examined concerns the amount of 
time that CTA respondents have been away from active duty. This information 
is given in table D-3-6. Eighty-seven percent were in the IRR for more than 
3 years. Two issues emerge: (1) the need for skill upgrading and (2) 
availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group, despite their 
beliefs (table D-3-6) in their continuing ability to perform job tasks at an 
acceptable level. CTA SMEs must make this determination, however, based on 
changes to how the job is now performed. 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. Further, an attempt should be made to 
determine why so few CTAs were in the IRR group separated less than 3 years. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-3-5. In table D-3-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 



ERLC 



D-3-14 

126 



Technical Report 86-007 



a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 22 percent of CTA IRRs reported that they now work in a 
civilian occupation related to the CTA rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-3-5 
shows, CTAs who now work in a field related to their Navy rating qained 
proficiency on two job tasks. The "W" subgroup also reported less skill 
deterioration for the other CTA job tasks than the "N" subgroup. Taken over 
all tasks, differences between the current (NOW) proficiency means for the 
two subgroups were statistically significant. Also, they could not be 
attributed to initial differences between the groups at EAOS Thus 
civilian CTA-related employment significantly affected skill deterioration! 
Those continuing to work in the CTA field after EAOS reported less 
deterioration. The tasks on which the greatest amount of skill 
deterioration occurred are easily identifiable from table 0-3-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the 
implications of skill deterioration data must be assessed against the 
criterion of acceptable level of proficiency. This can be done most 
directly by comparing the current proficiency levels reported by CTA IRRs 
against the levels reported Dy active duty CTA- 3s. The task means for the 

aC ^ Ve . .u y , samp , le . can be taken as E " 4 criterion performance since they 
reflect the level of proficiency claimed by the average CTA-3 now on active 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either table D-3-2 or D-3-3. The answer key shows that a value of 

4, for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 

4 is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
ll^X current i versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
il rnl ency cate 9°ry. For example, skill loss on tasks 6 to 8 occurred for 
the IRRs working in a related field. However, the losses reported resulted 
in the IRRs remaining in the -4- category (see table D-3-5). We would 
conclude that the deterioration is of no consequence insofar as signal inq a 
need for retraining. «»y 

Assessment of the need for training IRR personnel to support 
mobilization should proceed with the application of similar logic. Table 
D-3-7 below presents the task mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the CTA ratinq 

??L\ a S h°io f n" ^ 0Se T Wh ? are c . wo . rkin 9 ^ a related field. These values are 
from table D-3-5. Task proficiency means for active duty personnel working 
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in their rating (taken from table D-3-4) are also shown in table D-3-7. 
Inspection of tha data shows that all values are essentially "4"s. Hence, 
from these data alone, a fair conclusion is that training of CTA IRRs would 
not be required before mobilization to bring proficiency to an acceptable 
level. 

Table D-3-7 

Task Mean Proficiency Values for IRR and Active Duty CTAs 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


1 


3.5 


4.3 


4.3 


2 


4.1 


4.9 


4.8 


3 


4.1 


4.8 


4.7 


4 


3.9 


4.4 


4.1 


5 


4.1 


4.8 


4.6 


6 


3.5 


4.5 


4.3 


7 


3.5 


4.1 


3.7 


8 


3.5 


4,6 


4.3 


9 


3.9 


4.6 


4.2 



From our assessment, the current level of proficiency of CTA IRRs on 
all job tasks is probably adequate. There seems to be no need for extensive 
retraining c»r maintenance training of CTAs prior to mobilization. The 
average IRR CTA should be able to perform required job tasks at an 
appropriate level of competency with a modicum of refamili&rization at 
mobilization. For the most part, this could probably be given by close, 
corrective supervision while the returnee is performing job tasks. This 
conclusion pertains to all CTAs but is probably especially relevant to the 
22 percent of IRR CTAs who continue to work in an CTA-related occupation. 
Skill deterioration over all tasks of the rating was minimal. 

An additional factor to consider in assessing needs for training, 
however, concerns time since EAOS. Eighty-seven percent of the CTA IRRs in 
the sample were away from active duty for more than 3 years (see table D-3- 
6). Subject matter experts who review the data provided here may determine 
that skill upgrade training is required because of technical changes (e.g., 
new equipment, materials, procedures) in the field. 

VALIDATION OF DATA 

Our analyses indicate that the need for training of CTA IRRs against 
mobilization requirements is not great. It would appear that required 
proficiency (i.e., the level shown by current job incumbents) can for the 
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most part be achieved by familiarization training under direct corrective 
supervision in quite short time periods for most job tasks. There are no 
indications that comprehensive retraining for all rating tasks, such as 
would be provided in a formal school setting (e.g., "A" school), is needed. 
At worst case, instructional modules for training prospective CTA returnees 
on given individual tasks may be required. Information not readily 
available to the project staff is needed, however, for firm decisions about 
the need for training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the information provided by this report be 
evaluated/validated against a number of other considerations. Resource 
sponsors would be appropriate to validate training needs. 

Data Review 



As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the CTA 
rating. The NAVTRASYSCEN, if requested, could assist SMEs in this effort. 
Areas to be considered in the review/validation process are discussed next. 

Review Areas 



For our study, SMEs from the Naval Technical Training Center, Corry 
Station, Pensacola, FL, identified the job tasks they thought would be 
appropriate for returning IRR CTA members to perform. Other SMEs may not 
agree on the list. Resource sponsors should determine if these are the job 
tasks that an IRR returnee (at mobilization) should be able to perform. 
Further, a companion decision is required concerning the acceptability of 
the reported level of competency. Since active duty personnel report that 
they, on the average, now perform at these levels, these data reflect E-4 
criterion performance. Resource sponsors should consider whether less 
proficiency would be acceptable. If so, attendant training requirements for 
IRRs with concomittant resource requirements would be lessened. On judging 
the need for training, task critical ity, in terms of personnel or equipment 
safety as *t interacts with recent changes to material, procedures, or 
equipment, must also be considered. 



• 



An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at. recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 



9 

:RIC 



D-3-17 



129 



Technical Report 86-007 



replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Further, while decisions must still be made concerning formal 
training, either institutional or via OJT, our belief is that this type of 
training can be limited. 

Finally, based on (1) the IRR members' reports of their current 
relatively high residual levels of proficiency and (2) literature findings 
that maximum skill loss occurs after about 1 year of nonuse of skills, it 
appears that skill maintenance training for CTAs is not strictly necessary. 
Again, however, this conclusion must be weighed against planned utilization 
of recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the CTA IRR 
manpower pool may be smaller than believed. Approximately 33 percent of the 
pool may not be contactable by mail. An additional segment of unknown size 
may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage of CTAs listed in IRR files could also be 
beyond the zone of involuntary recall. 

2. CTA IRR personnel who work in civilian occupations related to 
their CTA rating reported less deterioration of skills than CTAs who are not 
similarly employed. This subgroup should be considered for first recall 
priority. 

3. Retraining and maintenance training for IRR CTAs is apparently not 
necessary to support mobilization. Familiarization training at recall 
consisting of supervised practice may suffice. This conclusion is subject 
to concurrence by subject matter expert CTAs. 

4. CTA personnel off active duty for more than 3 years may require 
training on selected tasks to update skills because of changes in equipment, 
procedures, or material despite their reported continuing high proficiency 
levels. 

5. Of the 9 CTA job tasks for which skill deterioration was assessed, 
indications are that none will require any concerted training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 

6. For all CTA IRRs, mean values of current proficiency reported 
compare favorably with those reported by active duty personnel. This 
finding also suggests minimal needs for retraining. 



130 °- 3 - 18 



Technical Report 86-007 



RCCOMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recal 1 . 

3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
school house SMEs adequately represent the CTA-3 job. Determine that the 
CTA-3 job is, in fact, acceptable a., the target performance level for 
training to support mobilization. Request resource sponsors consider the 
data of this study against factors such as changes to materials, procedures, 
equipment used by the rating, critical ity of task performance, and 
mobilization plans for IRR personnel. 

4. Consider recalling a sample of CTA IRRs to assess their knowledge 
of current CTA-3 job requirements. Use this information to validate the 
data and conclusions of this study. 
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APPENDIX D 



ANNEX 4 



CRYPTOLOGIC TECHNICIAN (INTERPRETIVE) (CTI) 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 

Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO). 0th<:r personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrHl 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by 0P-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Cryptologic 
Technician (Interpretive) (CTI) rating was one of these 16. 

PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels tosupport 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum acceptable proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 

APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Six senior 
enlisted CTIs, assigned to the Naval Technical Training Center (Corry 
Station, Pensacola, FL) Detachment, Goodfellow AFB, San Antonio, TX, served 
as subject matter experts (SME) for questionnaire development. Under 
guidance given by the project staff, the CTI SMEs selected from various 
source materials a set of job tasks that, in their judgment, best 
represented the job (non-NEC specific) of an active duty CTI-3. This level 
was chosen in the belief that a recalled ready reservist who could perform 
CTI job tasks competently at the E-4 level would make a positive work 
contribution to a receiving unit. 
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The CTI-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty CTI-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty CTI-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 10 December 1984, 484 CTIs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN). Questionnaires were mailed on 8 
February 1985 under CNO (OP-11) cover letter to a random sample of 367 (75 
percent). Coordination with the Commander, Naval Security Group 
(COMNAVSECGRU) had previously been accomplished. Because of a low initial 
return rate, a follow-up mailing (233) was made on 8 April 1985. 
Questionnaire returns were accepted until 24 May 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), 
COMNAVSECGRU, and within CNO (OP-01) was accomplished for authorization to 
survey active duty CTI-3 personnel. A CTI-3 roster, current as of 2 August 
1985, was obtained from NAVMILPERSCOM. From a pool of 181, a sample of 155 
CTI-3s was determined using accepted survey research methods. 
Questionnaires were mailed on 18 September 1985 under CNO (OP-11) cover 
letter to unit/activity commanding officers for distribution to CTI-3s 
named . Returns were accepted unti 1 31 December 1985. Returned 
questionnaires were scanned to determine data usability, and data were 
entered into computer files. Subsequently, summaries of the information of 
interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of CTI skill deterioration are 
presented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table D-4-1 shows, for both the IRR and active duty CTIs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
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sample, the number/percent of nonvalid returns (nonvalid principally because 
of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (77) by the number delivered (i.e., 367 - 118 = 
249). 

Table D-4-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


367 


77 


48 


118 32 


Active Duty 


155 


79 


51 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-4-2 for IRR personnel and in table D-4-3 for active duty personnel. 
The tables are modified questionnaire forms. 

Background Questions 

Of 76 IRR CTIs answering the question, 8 (approximately 11 percent) 
reported that they now work in a civilian occupation related to their Navy 
CTI rating. Answers to the remaining two background questions for IRRs (see 
table D-4-2) are not reported since it was determined that the answers might 
be redundant and could not be unambiguously interpreted. Of the active duty 
respondents answering the background questions (see table D-4-3), 73 of 78 
(93.5 percent) work in rating. Seventy-eight percent are assigned sea duty. 



Task Performance Data 

The data summary tables (D-4-2 and D-4-3) show the number (F) and 
percent {%) of respondent 6 reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
"1.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of data (r = .836, p< .05) 
indicated significant agreement between the two classes of respondents. 
Thus, tasks which have not been performed by active duty CTIs (to date) are 
the same tasks that had not been performed by IRRs at EAOS. 



ERIC 



D-4-5 



135 



Technical Report 86-007 



Table D-4-2 

Overall Summary of CTI IRR Questionnaire Data 



PART 1: 



AMSWEK KEY: 



1. If necessary, comet your Service 



Is the work Which you do VOW rtUUd 
to your mavy rating? 

Yes _L 

Have you done PMViOUS work Which it 
related to your levy rating 
sinca your Ixpiratloa of Activa 
Obligated Sarvica (lAOS)f 
Yem mo 

Have you received training related to 
your lavy rating since your Expiration 
of active Obligated Service (IAOS)f 
Yea - lo - 



(X) Have never performed the teak. 

(2) Can/could do a lap la parte of the task 
(need direct supervision) . 

(3) Can/could do must parts of the teak 
(need general supervision). 

(4) Can/could do all parte of the tesk 
(need only occesionei supervision. 
Meets minimum local spaed and accuracy 
standards . ) 

(5) Can/could do coaplete task quickly and 
accurately (need no supervision) . 



PAST 2: 

For eech job tesk statement below: 

A. Zndicete your CUBRER level of ability according to the answer key ebove. 

B. Estimate your PttVXOUS level of ability at the tine of your tAOS according to 
the answer key above. 



• 



"(1)" Choices 
E * 

6 21.1 1 
5 6.5 S 
8 10.5 3 



37 49.3 
32 42.1 



Tasks 

Select antennas and transmission 
lines; identify BF interference. 

Operate » tune, and calibrate 
electronic equipment. 

Operate radiotelephone positions; 
maintain handlogs. 

Recognise, identify, and report 
significant Items of Interest. 

Use technical working aids 
(e.g., dictionaries). 

Operate word processor. 

Operate computer beeed collection 
systems. 



V Mean SD V Mean SD 

76 2.47 1.227 76 3.37 1.565 

77 2.95 1.356 77 3.96 1.251 

75 2.99 1.409 76 4.20 1.276 

76 3.40 1.108 76 4.53 .683 

76 4.22 1.115 77 4.77 .484 

76 3.16 1.567 75 2.55 1.671 

76 2.63 1.522 76 2.70 1.633 
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< D-4-2 (Continued) 



1.3 8. Transcribe magnetic tap* recordings 77 3.03 1.135 77 4 2* 834 
and translate written material. 

5.2 9. Perform basic radio traffic analysis. 77 2.94 1.185 77 4.12 1.112 

9.1 10. Identify classes of tercet snips and 77 2.47 1 ^71 77 3.78 1 242 

aircraft, and their associated 
weapon system*. 

5.2 11. Handle, account for, stow, transmit, 77 3.38 1.378 77 4.27 1 120 

and destroy classified material. 

8.5 12. Calculate time conversions. 77 3.82 1.489 77 4.08 1.273 

10.4 13. Pass e Foreign Language Aptitude 78 2.83 1.220 77 3 84 1 319 
Maintenance (FLAFtU) examination. 

15.8 14. Prepare for and perform fleet direct 77 2.51 1.221 77 3.71 1.512 
support operations. 

5.3 15. Prepare reports and summaries. 77 3.43 1.381 78 4.17 l.ioo 

8.8 18. Interpret categories of gloisT 75 2.55 1.154 76 3.95 1.188 
alerts. 

17. I can/could type. 71 39wpa 15.344 73 39wpm 13.219 

Overall mean: 3. 00 
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Table D-4-3 

Overall Summary of CTI Active Duty Questionnaire data 



PAST 1; 



1. If necessary, cornet your Service 
■umber. 

2. Does your current billot require you 
to work in your levy rat Lot? 

Toe 73 Mo 5 

3. Whet type duty if your current 
bllletf 

See §0 Shore 17 



AHSVES KSY; 



(1) Have never performed the teak. 

(2) Can/could do simple parti of the taik 
(need direct eupervieion) . 

O) Can/could do bo ft parti of the teak 
(need general euperviiion) . 

<4* Can/could do all parti of the taik 
(need only occasional eupervieion. 
Meete minimum local apeed end accuracy 
etendarde.) 

(5) Can/could do complete teak quickly end 
accurately (need no •uperviilon) . 



PAST 2: 

For each job teak itatement below: 

A. Use the anewer key ebove to indicate your CUSSBHT level of ability. 

B. Use the anewer key ebove to estimate your EXPBCTBD level of ebility after 2 
years of n©i per fo reins theee taeke. 



"(1)- Choices A B 

Z % Tasks V Mean 8D V Keen SD 

26 32.9 1. Select antennas and transmission 79 2.80 i.*64 75 2.36 1.270 
lines; identify SF interference. 

13 16.5 2. Operate, tune, and calibrate 79 3.49 1.484 75 2.79 1.200 
electronic equipment. 

6 7.6 3. Operate radiotelephone positions; 79 a. 25 I. in 76 3.24 1.106 
maintain hand logs . 

1 1.3 4. Becognits, identify, and report 78 4.32 .'J30 75 3.32 1.067 
significant iteea of interest. 

1 1.3 5. Use technical working aide 78 4.78 .595 75 4.16 .959 
(e.g., dictionaries). 

15 14.2 6. Operate word processor. 78 3.37 1.487 73 2.92 1.289 

40 50.6 7. Operate coeputsr based collection 79 2.41 1.597 74 2.23 1.350 
systems. 
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Table D-4-3 (Continued) 



1 

7 

22 ti 
7 

13 V 



.6 S. Transcribe smgnetlc tap* recordings 78 4.14 1.041 76 3.05 1.153 
end transitu writ tan matsrial. 

5 9. Perform basic radio traffic analysis. 79 3.89 1.109 74 2.97 1.134 

3 10. Identify classes of targst ships and 79 3.57 1.117 77 2.43 1.044 
aircraft, and thtlr associated 
weapon system. 

1 11. Handle* account for, stow, transmit, 79 3.94 1.158 76 3.11 1.173 
and destroy classified sjetsrlal. 

3 12. Calculate ties conversions. 79 3.94 1.158 76 3.11 1.173 

.0 13. Pass a Fore lan Language aptitude 78 3.68 1.324 75 2.53 1.082 
Maintenance (PLaJtU) examination. 

.2 14, Prepare for and perform fleet direct 78 3.15 1.612 75 2.37 1.271 
support operations. 

.0 15. Prepare reports and susmarles. 78 3.83 1.221 74 2.92 1.156 

.5 16. Interpret categories of SIOIaT 76 3.30 1.433 72 2.54 1 198 
Alerts. 

17. I can/could type. 
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Tables D-4-2 and D-4-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SD) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR sample, table D-4-2, the "A" column 
reflects current average ability level; the "B" column, EAOS average ability 
level. For the active duty sample (table D-4-3), the "A" column refers to 
current (NOW) ability and the "B" to proficiency expected after 2 years of 
nonperformance of a task.l A Pearson Product Moment Correlation (r = .824, 
pX«05) computed between task means for IRR EAOS and active cFuty NOW 
(current proficiency) values indicates that the IRR members, while on active 
duty, performed job tasks at competency levels equivalent to those of 
current job incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering thr CTI-3 job in its entirety (as reflected by the tasks used) 
the average IK -nember feels that he could now perform most tasks of the 
rating at a level where general supervision would be needed (mean = 3.0). 

For the active duty group, means reflecting proficiency on each job 
task for CTIs working/not working in their rating were computed. These are 
shown in table D-4-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-4-5 displays task proficiency means for two subgroups of the 
CTI IRR respondents: (1) those who answered that they were now working , 
"W," in a field related to the Navy CTI rating and (2) those who indicated 
that they were not working ("N") in a related field. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-4-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key, These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-4-5, alues 
preceded by a minus sign represent a decrease in proficiency dur\ig IRR 
membership: current proficiency is less than EAOS proficiency. Values with 
no signs would have indicated increases in proficiency. 

The table shows that all CTIs lost proficiency on all job tasks. The 
"W" subgroup reported less skill deterioration than the "N" group for 9 of 
the 16 job tasks. Statistical tests (t tests for independent means; see 
Guilford and Fruchter, 1973) indicated that over all tasks of the CTI 
rating, the two subgroups differed significantly at EAOS (t - .3.71, 
£<.0004) and, also, on current (NOW) proficiency (t = 2.74, p< .00?). 




*These expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since 1t was clear that many respondents did not 
understand the question being asked. 
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Table D-4-4 

Task Mean Values for Two Subgroups of Active Duty CTIs 



Task 


Not Working ("N") 1 
NOW EXP 




Working ("W") 2 
NOW EXP 


1 


1.000 


3.000 




3.712 


2.980 


z 


3.000 


2.500 




4.016 


3.097 


3 


3.000 


2.333 




4.571 


3.391 


A 

4 


3.600 


4.250 




4.423 


3.304 


5 


4.600 


4.200 




4.845 


4.206 


6 


3.600 


3.400 




3.982 


3.309 


7 


4.000 


3.000 




3.838 


3.205 


8 


3.333 


2.667 




4.264 


3.143 


9 


3.667 


3.000 




3.973 


3.075 


10 


3.000 


2.500 




3.783 


2.797 


11 


3.800 


3.750* 




4.130 


3.262 


12 


4.250 


A Ann 

4.000 




A TOO 

4.333 


3.824 


13 


3.000 


3.500 




4.000 


2.758 


14 


2.000 


2.000 




4.074 


3.061 


15 


4.400 


4.000 




4.092 


3.000 


16 


4.000 


3.333 




3.780 


2.962 




Composite Mean: 


Group W 


NOW 


4.114 










EXP 


3.211 








Group N 


NOW 


3.328 










EXP 


3.215 






Overall Mean: 




NOW 


3.721 










EXP 


3.213 





In = 5 
2n = 73 
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Table 0-4-5 



Task Mean Values for Two Subgroups of IRR CTIs 





Not Working ("N") 1 


Working ("W") 2 




Mean 


Di f ference 


Task 


NOW 


EAOS 


NOW 


EAOS 




"N" 


"W" 


1 


3.060 


3.963 


2.800 


4.333 




n om 


-1. OOO 


? 


3.317 


3.421 


3.750 


4.000 




_n i ha 

-U. 1UH 


-U. LOU 


J 


3.421 


4.565 


3.750 


4.667 




-1 1 AA 
"1 • 1HH 


n qi 7 

-U. ^1/ 


4 


3.439 


4.500 


4.000 


4.750 




-1 • UOl 


-u. / ou 


5 


4.269 


4.754 


4.714 


4.875 




U • HOO 


n l fii 

-U. 101 


6 


3.840 


3.970 


4.143 


4.600 




-0.130 


-0.457 


7 


3.419 


3.821 


4.333 


4.800 




n A09 


n acli 
-u.*io/ 


8 


3.062 


4.279 


3.750 


4.500 




-1.217 


-0.75" 


Q 


3.048 


4.262 


3.857 


4.500 




- 1 91 A 
-1 . CiH 


n &A 

-U. 0*tw 


1U 


2.754 


3.984 


3.167 


4.714 




-l.£OU 


-1.54/ 


11 


3.531 


4.409 


4.333 


4.857 




n Q7Q 
-U.o/o 


-U.5Z4 


12 


1 917 


4.292 


3.833 


4.286 




-0.355 


-0.453 


13 


2.810 


4.148 


3.375 


4.375 




-1.338 


-1.000 


1 A 

JL4 


2.963 


4.169 


3.000 


4.667 




-1.206 


-1.667 


15 


3.581 


4.297 


4.375 


4.750 




-0.716 


-0.375 


16 


2.807 


4.141 


3.600 


4.286 




-1 WA 


-u.oou 






Composite Mean: Group W NOW 


3. 


799 












EOS 


4. 


560 










Group N NOW 


3. 


329 












EOS 


4. 


186 








Overal 1 


Mean: 


NOW 


3. 


564 












EOS 


4. 


373 





In = 68 
2n = 8 
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TINE IN IRR 

Table D-4-6 provides a breakdown of CTI personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time and for 
IRRs off active duty more than 3 years. These mean values are shown for 
information only, since the number of individuals in each group is too small 
to permit meaningful quantitative interpretation. 

Table D-4-6 



Mean Proficiency Values for CTI IRR Respondents by Time Since EAOS 



Time (Mos.) 
Since EAOS 


Mean 


No. of Cases 


0-5 


3.23 


6 


6-11 






12-17 


4.63 


1 


18-23 






24-35 


3.71 


3 


36+ 


2.92 


60 


Overall Mean 


3.00 


70 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rate coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 
previously. They also suggest directions that should be taken with respect 
to the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

Approximately 32 percent of questionnaires returned were classified as 
"nonvalid" (table D-4-1). This category reflects probable errors in the IRR 
data base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
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included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from another 
service, was never on active duty in the Navy/ 1 (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 19850 Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased." From the above data, it can be concluded that about 32 
percent of the CTI IRRs could not or would not be available for 
mobilization. 

Questionnaires were presumably delivered by the Postal Service to a 
number of C'fls (69 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above--they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the CTI 
IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that CTi respondents have been away from active duty. This information 
is given in table D-4-6. Eighty-six percent were in the IRR for more than 3 
years. Two issues emerge: (1) the need for skill upgrading and (2) 
availability of IRR members. Upgrade training because of new equipment, 
procedures, or material will probably be required for this group. CTI SMEs 
should make this determination based on changes to how the job is now 
performed . 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who a^e beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table 0-4-5. In table D-4-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately il percent of CTI IRRs reported that they now work in a 
civilian occupation related to the CTI rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-4-5 
shows, CTIs who now work ("W") in a field related to their Navy rating 
reported less skill deterioration for nine of the CTI job tasks than the "N" 
subgroup* Taken over all tasks, differences between the current (NOW) 
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proficiency means for the two subgroups were statistically significant. 
These differences in proficiency also existed between the groups at EAOS, 
however. Former CTIs who as civilians chose to work in a CTI-related field 
showed significantly less skill deterioration over all job tasks. But, the 
differences could have been due to conditions (unknown) that affected their 
EAOS proficiencies. 

The tasks on which the greatest amount of skill deterioration occurred 
are easily identifiable from table D-4-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the 
implications of skill deterioration data must be assessed against the 
criterion of acceptable level of proficiency. This can be done most 
directly by comparing the current proficiency levels reported by CTI IRRs 
against the levels reported by active duty CTI-3s. The task means for the 
active duty sample can be taken as E-4 criterion performance since they 
reflect the level of proficiency claimed by the average CTI-3 now on active 
duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on eit.ier table D-4-2 or D-4-3. The answer key shows that a value of 
"4," for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
"4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
proficiency category. For example, skill loss on tasks 2 to 9 occurred for 
the IRRs working in a related field. However, the losses reported resulted 
in the IRRs remaining in the "4" category (see table D-4-5). We would 
conclude that the deterioration is of no consequence insofar as signaling a 
need for retraining. 

Assessment of the need for training IRR personnel to support 
mobilization should proceed with the application of similar logic. Table 
D-4-7 below presents the tas* mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the CTI rating 
and also for those who are working in a related field. These values are 
from table D-4-5. Task proficiency means for active duty personnel working 
in their rating (taken from table D-4-4) are also shown in table D-4-7. 
Inspection of the data shows that 12 of the 16 job tasks are essentially 
"4"s for IRR CTIs working in a related field. For IRR CTIs not working in a 
related field only, 5 of the 16 job tasks are "4"s. Hence, from these data 
alone, a fair conclusion is that' training of CTI IRRs working in a related 
field would not be required on the 12 tasks identified to bring proficiency 
to an acceptable level before mobilization. On the other hand, considerab^ 
training of CTI IRRs not working in a related field would be recommended. 
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Table 0-4-7 

Task Mean Proficiency Values for IRR and Active Duty CTls 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Ratina 




3.1* 


2.8* 


3.7 


i 


3.3* 


3.8 


4.0 


1 
0 


3.4* 


3.8 


4.6 


4 


3.4* 


4.0 


4 4 


5 


4.3 


4.7 


4.8 


6 


3.8 


4.1 


4.0 


7 


3.4* 


4 3 


"X ft 
J . o 


8 


3.1* 


3.8 


4.3 


9 


3.0* 


3.9 


4.0 


10 


2.8* 


3.2* 


3.8 


11 


3.5 


4.3 


4.1 


12 


4.0 


3.8 


4.3 


13 


2.8* 


3.4* 


4.0 


14 


3.0* 


3.0* 


4.1 


15 


3.6 


4.4 


4.1 


16 


2.8* 


3.6 


3.8 


♦Probable training needs. 







From our assessment, there is no apparent need for extensive retraining 
or maintenance training of CTIs now working in the field. The data indicate 
that the average IRR CTI in this category should be able to perform required 
job tasks at an appropriate level of competency with a modicum of 
^familiarization at mobilization. The picture is different for CTI IRRs 
not working in the field. In this case, the average IRR CTI can not be 
expected to be able to perform required job tasks at mobilization. Due to 
the nature of the CTI job, tasking should be issued to the appropriate CT 
community to develop a specialized premobilization curriculum for the 
rating. 

For a number of reasons, even though the data reviewed above might 
indicate otherwise, we would also recommend formal refresher training for 
the CTIs who are working in jobs related to their rating. These reasons 
stem from the intrinsic nature of the CTI job and the limitations of most 
civilian employment for providing practice opportunities on the many aspects 
of this job. For those relatively few IRR CTIs who are in civilian jobs 
related to the rating, training requirements would certainly be less than 
for the remaining IRRs. 

Any K-remobil ization curriculum developed for CTIs should consider the 
findings of research literature that reacquisition of lost skills requires 
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about one-half the time required to acquire these skills originally. Also, 
a mobilization curriculum should be flexible enough to accommodate specific 
training needs of individual CTIs. The tasks identified in table D-4-7 
should be appropriately emphasized in the curriculum. Training for both 
basic and operational skills must be considered. 

An additional factor to consider in assessing needs for training 
concerns time since EAOS. Eighty-six percent of the CTI IRRs in the sample 
were away from active duty for more than 3 years (see table D-4-6). Subject 
matter experts who review the data provided here may determine that skill 
upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. These needs could clso be 
incorporated into a specialized curriculum. 

VALIDATION OF DATA 

Our analyses indicate that there is a need for training CTI IRR:: to 
support mobilization. Formal refresher training appears to be the best 
solution. In some cases, instructional modules for training prospective CTI 
returnees on given individual tasks may suffice. Information not readily 
available to the project staff is needed, however, for firm decisions about 
the need for training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the information provided by this report be 
evaluated/validated against a number of other considerations. Resource 
sponsors would be appropriate to validate training needs. 

Data Review 

As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be usad because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the CTI 
rating. The NAVTRASYSCEN, if requested, could assist SMEs in this effort. 
Areas to be considered in the review/validation process are discussed next. 

Review Areas 

For our study, SMEs from the Naval Technical Training Center (Corry 
Station) Detachment, Goodfellow AFB, San Angelo, Texas, identified the job 
tasks they thought would be appropriate for returning IRR CTI members to 
perform. Other SMEs may not agree on the list. Resource sponsors should 
determine if these are indeed the job tasks that an IRR returnee (at 
mobilization) should be able to perform. Further, a companion decision is 
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required concerning the acceptability of the reported level of competency. 
Since active duty personnel report that they, on the average, now perform at 
these levels, these data reflect E-4 criterion performance. Resource 
sponsors should consider whether less proficiency would be acceptable. If 
so, attendant training requirements for IRRs with concomittant resource 
requirements would be lessened. On judging the need for training, task 
criticality, in terms of personnel or equipment safety, or mission success, 
as it interacts with recent changes to material, procedures, or equipment, 
must also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the CTI IRR 
manpower pool may be smaller than believed. Approximately 31 to 32 percent 
of the pool may not be contactable by mail. An additional segment of 
unknown size may have already reenlisted and/or not be useful to the Navy 
for other reasons. A substantial percentage of CTIs listed in IRR files 
could also be beyond the zone of involuntary recall. 

2. CTI IRR personnel who work in civilian occupations related to 
their CTI rating report less deterioration of skills than CTIs who are not 
similarly employed. This group should be considered for first recall 
priority. 

3. Retraining for all CTIs, regardless of civilian occupation, 
appears necessary to support mobilization. Formal refresher training prior 
to recall appears to offer the best solution to training needs. This 
conclusion is subject to concurrence by subject matter expert CTIs. 

4. Periodic maintenance training, after refresher training, would 
guard against future unwanted erosion of skills. 

5. CTI personnel off active duty for greater than 3 years will 
probably require training on selected tasks to update skills. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 
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2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall. 

3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
schoolhouse SMEs adequately represent the CTI-3 job. Determine that the 
CTI-3 job is, in fact, acceptable as the target performance level for 
training to support mobilization. Request resource sponsors to consider the 
data of this study against factors such as changes to materials, procedures, 
equipment used by the rating, critical ity of task performance, and 
mobilization plans for IRR personnel. Request resource sponsors determine 
the validity of data provided. 

4. Issue appropriate tasking, if the conclusions of this study are 
accepted, to develop a specialized mobilization curriculum for refreshing 
basic skills, and refreshing and updating operational skills. 

5. Task the NAVTECHTRACEN , Corry Station, to develop or assist 
development of a premobilization curriculum for CTI IRRs and a skill 
maintenance curriculum. 

6. Recall a sample of CTI IRRs to assess their knowledge of current 
CTI-3 job requirements. Use this information to validate the data and 
conclusions of this study. 
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APPENDIX D 
ANNEX 5 



CRYPTOLOGIC TECHNICIAN (MAINTENANCE) (CTM) 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
otner reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armcu 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
'er (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by 0P-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Cryptologic 
Technician (Maintenance) (CTM) rating was one of these 16. 



PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Impl -it in the tasking was the additional requirement to 
define minimum acceptable proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any training regimen should attempt to 
achieve. 



ERIC 



APPROACH 

Complete detiiis of the technical approach to the stud> are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Five senior 
enlisted CTMs, assigned to the Naval Technical Training Center, Corry 
Station, Pensacola, FL, served as subject matter experts (SME) for 
questionnaire development. Under guidance given by the project staff, the 
CTM SMEs selected from various source materials a set of job tasks that, in 
their judgment, best represented the j-b (non-NEC specific) of an active 
duty CTM-3. This level was chosen in the belief that a recalled ready 
reservist who could perform CTM job tasks competently at the E-4 level would 
make a positive work contribution to a receiving unit. 
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The CTM-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty CTM-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty Clrt-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 10 December 1984, 170 CTMs were listed in Naval Military 
Personnel Command (NAVMILPERSCEN) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCEN through the Naval 
Reserve Personnel Center (NAVRESPERSCEN) . Questionnaires were mailed on 22 
February 1985 under CNO (OP-11) cover letter to a random sample of 77 (45 
percent). Coordination with the Commander, Naval Security Group 
(COMNAVSECGRU) had previously been accomplished. Because of a low initial 
return rate, a follow-up mailing (62) was made on 8 April 1985. 
Questionnaire returns were accepted until 24 May 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT) , 
COMNAVSECGRU, and within CNO (OP-01) was accomplished for authorization to 
survey active duty CTM-3 personnel. A CTM-3 roster, current as of 2 August 
1985, was obtained from NAVMILPERSCEN. From a pool of 792, a sample of 321 
CTM-3s was determined using accepted survey rf search methods. 
Questionnaires were it iled on 18 September 1985 under v,N0 (0P-12) cover 
letter to unit/activity commanding officers for distribution to CTM-3s 
named. Returns were accepted until 31 December 1985. Returned 
questionnaires were scanned to determine data usability, and data were 
entered into computer files. Subsequently, summaries of the information of 
interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of CTM skill deterioration are 
presented in this section. All results presented concerning IRR CTMs must 
be considered as "information only" because of the very low sample size 
available. 
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QUESTIONNAIRE RETURN STATISTICS 

Table D-5-1 shows, for both the IRR and active duty CTMs, the number of 
questionnaires lailed and number and percent of usable returns. For the irr 
STSl?; h he number /P er . cent of nonvalid returns (nonvalld princ pal ll beca se 
of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (11) by the number delivered (i ef, 77 - 31 = 

Table D-5-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable Returns 
No. % 


Nonvalid 
No. X 


IRR 


77 


11 


24 


31 40 


Active Duty 


321 


216 


67 





QUESTIONNAIRE DATA SUMMARIES 



t a hi a S lf n, !^ i ? S °L data obuined from the questionnaires are presented in 

S ?.Srf; 2 /.° r ! ™ pe r sonnel and in table D-5-3 for active duty personnel 
The tables are modified questionnaire forms. kwmwhwi. 



Background Questions 



Of 11 IRR CTMs answering the question, 7 (approximately 64 Dercpnt^ 
reported that they now work in a civilian occupatio re ated to thUr Zl 

tl5il I S 9 ^ AnSW6 7 t0 the remainin 9 two background questions for IRRs (see 
table D-5-2) are not reported since it was determined that the answers m nht 
be redundant and could not be unambiguously interpreted of the aaive d25v 
respondents answering the background questions (see table D-5-3) 202 of 211 

as^ieTs^UT' " ratin9 ' ^ ^ "* Wv£S£) III 



Task Performance DaU 



percent m* V"*" (D ~ 5 " 2 , and D - 5 " 3) show the "«»>er (F) and 

«-"5 Lw jas. t rt r„ « a. « ■* 5 ^ i $ 
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Table D-5-2 

Overall Summary of CTM IRR Questionnaire Data 



FAST 1: 



ANSWER KEY: 



1. If necessary, comet your service 



4. 



Is the work Which y i do KM related 
to your lavy rating? 

Ya» 7 ffo 4 

Hava you dona FUVI0U8 work Which is 
related to your levy rating 
sine a your Expiration of active 
Obligated Sarvica (EAOS)T 

Yas - Wo - 

Hava you raceived training raiatad to 
your lavy rating sinca your Expiration 
of Active Obligated Sarvica (EAOS)f 
Yas - Eo - 



U) Hava navar performed tha task. 

(2) Can/could do simple parts of tha task 
(naad direct supervision) . 

(3) Can/could do most parts of the task 
(naad ganarai supervision) . 

(4) Can/could do aii parts of the task 
(naad only occasional supervision. 
Meets minimum local speed and accuracy 
standards.) 

(5) Can/could do complete task quickly and 
accurately (need no supervision). 



PART 2: 



For each job task statement below: 

A. Indicate your CURBEHT level of ability according to the answer key above. 

B. Estimate your PREVIOUS level of ability at tha tine of your EA08 according to 
the answer key abovs. 



"(1)" Choices A B 

C % Tasks H Mean 8D V Meen 80 

1 1.3 1. Effect changes to technical end 11 3.90 1.446 11 3.03 1.433 

Maintenance publ 1 cat ions. 

1 1.3 2. Perform Maintenance end operational 11 4.27 1.104 11 4.09 1.375 
teata on equipments align, adjust, 
and calibrate e*. Jpment; align 
frequency determining devices. 

1 1.3 3. Use general end/or apeclal purpose u 4.36 .924 11 4.36 1.206 
teat equipment and perform corrective 
maintenance on electronic end 
electromechanical eqi-'pment . 

1 1.3 4. Identify basic solid state circuits 11 3.90 1.375 11 4.27 1.272 
and methods of biasing electronic 
circuits* 

1 1.3 5. Evaluate logic circuits; compute 11 4.09 1.375 11 4.00 1.414 

current, voltage, power, resistance* 
capacitance, and inductance. 



ERLC 



D-5-6 

154 



Technical Report 86-007 
Table D-5-2 (Continued) 



1 1.3 6. Identify resistance and power 11 3.90 1.446 11 4.09 1.221 

handling capabilities of electrical 
conductors; tost sad rsplses 
batteries; sdjust and repair 
chars ins and switching circuits; 
identify principles associated 
with routing electrical Machinery. 

7. Complete Maintenance date fore* ; 11 3.72 1.191 11 4.64 .674 

order replacement parts and tools; 
inventory parts and tools; understand 
311 system. 

»• Properly handle, stow, and destroy 11 3.90 1.375 11 5.00 
classified meterlsl. 

2 2.6 9. Interpret functions of the MaVStCOlU; 11 3.64 1.286 11 4.00 1.612 

interpret SX security classification 
designations and categories. 

10. Use and sain tain portable power 11 4.82 .405 11 4.91 .302 

tools and hand tools. 

4 5.2 11. ftun diagnostic routines on jeneral 11 4.36 1.027 11 3.24 1.902 
purpose and special purpose 
computers and peripheral equipment; 
record results. 

1 1.3 12. Isolate cossjunlcatlons circuit 11 3.63 1.286 11 4.00 1.414 

casualties . 

1 1.3 13. Perform corrective and preventive 11 3.46 1.508 11 4.46 1.214 

Maintenance on antennas. 

Overall Mean: 3.98 
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Table D-5-3 

Overall Summary of CTM Active Duty Questional are Data 



PAST 1; 



AISWEK KEY: 



1. If necessary, correct your Service 



2. Does your current billet require you 
to work in your Wavy rat Ins T 

Yes 202 Wo 9 

3. What type duty is your current 
billett 

See 195 Shore 17 



(1) Have never per f oread the task. 

(2) Can/could do simple parts of the task 
(need direct supervision). 

(3) Can/could do nost parts of the task 
(need general supervision). 

(4) Can/could do all parts of the teak 
(need only occasional supervision. 
Meets sdniausi local speed and accuracy 
standards.) 

(5) Can/could do complete task quickly and 
accurately (need no supervision) . 



PAST 2: 

For each job task eta tenant below: 

A. Use the answer key above to indicate your CUBSEWT level of ability. 

B. Use the answer key above to estimate your EXPECTED level of ability after 2 
years of no± performing these tasks. 



"(1)" Choices A B 

£ * Tasks W Mean SD W Mean SD 

52 24.1 1. Effect changes to technical and 216 3.34 1.553 213 2.97 1.390 

maintenance publications. 

7 3.3 2. Perform maintenance and operational 215 ',.16 .939 214 3.31 1.007 
tests on equipment; align, adjust, 
and calibrate equipment; align 
frequency determining devices. 

I .5 3. Use general and/or special purpose 215 4.32 .787 215 3.43 .978 
test equipment and perform corrective 
maintenance on electronic and 
electromechanical equipment. 

7 3.3 4. Identify basic solid state circuits 215 3.90 1.009 213 3.14 1.128 
and methods of biasing electronic 
circuits* 

6 2.8 5. Evaluate logic circuits; compute 215 4.15 .942 215 3.30 1.187 
current, voltage, power, resistance, 
capacitance, and inductance. 
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13 6.0 6. Identify rtilitinei and pernor 215 3.73 1.120 213 3. Of 1.113 

Handling capabilities of alaetrical 
conductors; tatt and replace 
battarlaa; adjuat and rapair 
chart ins end switching circuits; 
Identify principle* aaaociatad 
with rotating alaetrical machinery. 

2 .9 7. Coapiata naintananca data focat; 214 4.33 .793 213 3.23 1.030 
ordar replacement part a and too is; 
inventory parts and tools; understand 
3H system. 

12 3. a 8. Properly handle, stow, and destroy 213 4.09 1.107 216 3.44 1.211 
classified aaterlel. 

18 S. 4 9. Interpret functions of the EAVIECCtU; 214 3.38 1.133 213 2.84 1.127 
interpret 81 eecurity classification 
designations and categories. 

2 .9 10. Use and maintain portable power 215 4.64 .766 213 4.37 1.000 
tools and hand tools. 

29 13.3 11. Sun diagnostic routines oVi general 213 3.34 1.346 214 3 00 1.228 
purpose and special purpose 
conputers and peripheral equipment; 
record results. 

16 7.4 12. Isolate communications circuit 213 3.77 1.176 213 3.12 1.200 
casualties. 

83 38.4 13. Perform corrective and preventive 216 2.63 1.316 211 2.36 1.318 
maintenance on antennae. 
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Tables D-5-2 and D-5-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SD) around the mean, and the number of cases (n; on 
which a mean is based. For the IRR sample, table 0-5-2, the "A" column 
reflects current average ability level; the M B M column, EAOS average ability 
level. For the active duty sample (table D-5-3), the "A" column refers to 
current (NOW) ability and the "B M to proficiency expected after 2 years of 
nonperformance of a task.l A Pearson Product Moment Correlation (r = .431, 
p>.05) computed between task means for IRR EAOS and active cfuty NOW 
(current proficiency) values indicates that the IRR members, while on active 
duty, did not perform job tasks at competency levels equivalent to those of 
current job incumbents. However, the number of CTMs who responded to this 
survey is so small that this conclusion is equivocal. 

For the IRR group, an overall grand mean for current proficiency was 
computed, over all tasks for the rating. This single number indicates that 
considering the CTM-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean - 3.98). 
Note again, however, that this mean is based on only 11 IRR CTMs. 
Consequently, little credence can be given. 

For the active duty group, means reflecting proficiency on each job 
task for CTMs working/not working in their rating were computed. These are 
shown in table D-5-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-5-5 displays task proficiency means for two subgroups of the 
CTM IRR respondents: (1) those who answered that they were now working , 
"W," in a field related *o the Navy CTM rating and (2) those who indicated 
that they were not working ( 11 N 11 ) in a related field. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-5-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key* These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In taole D-5-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 
membership: current proficiency is less than EAOS proficiency. Values with 
no signs indicate increases in proficiency. The data are presented for 
information only. 



lThese expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since it was clear that many respondents did not 
•understand the question being asked. 
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Table 0-5-4 

Task Mean Values for Two Subgroups of Active Duty 

■ 1 5 

Not Working ("N'T Working ("W'T 

Task NOW EXP NOW EXP 

1 4.200 3.400 4.103 3.404 

2 4.250 3.250 4.272 3.385 

3 4.625 3.625 4.328 3.472 

4 3.625 3.000 4.031 3.303 

5 4.125 3.250 4.260 3.450 

6 3.750 3.000 3.926 3.250 

7 4.625 3.500 4.367 3.273 

8 4.714 4.143 4.251 3.592 

9 4.000 3.333 3.812 3.0U 

10 4.333 4.222 4.683 4.402 

11 3.667 3.000 3.954 3.316 

12 4.125 3.000 4.011 3.335 

13 4.000 3.000 3.654 3.030 



Composite Mean: Group W NOW 4.127 

EXP 3.402 

Group N NOW 4.157 

EXP 3.363 

Overall Mean: NOW 4.142 

EXP 3.383 

*n = 9 
2 n = 202 
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Table D-5-5 

Task Mean Values for Two Subgroups of IRR CTMs 



Not Working ("N") 1 Working ("W") 2 Mean Difference 

Task NOW EAOS NOW EAOS "N" "W" 



1 


3.750 


3.750 


4.500 


4.000 


0.000 


0.500 


c 






A QC7 


4.00/ 


-0.750 


0.190 


3 


3.75U 


4.500 


4.714 


4.833 


-0.750 


-0.119 


4 


3.667 


4.667 


4.429 


4.571 


-1.000 


-0.142 


5 


3.667 


4.667 


4.714 


4.143 


-1.000 


0.571 


6 


3.667 


4.667 


4.429 


4.286 


-1.000 


0.143 


7 


3.750 


5.000 


3.714 


4.429 


-1.250 


-0.715 


8 


4.000 


5.000 


4.286 


5.000 


-1.000 


-0.714 


9 


3.333 


5.000 


3.714 


4.500 


-1.667 


-0.786 


10 


4.750 


5.000 


4.857 


4.857 


-0.250 


0.000 


11 


4.000 


4.333 


4.571 


4.750 


-0.333 


-0.179 


12 


3.667 


5.000 


4.000 


4.000 


-1.333 


0.000 


13 


3.667 


5.000 


4.167 


4.667 


-1.333 


-0.500 






Composite Mean: 


Group W 


NOW 4.381 







EOS 4.516 

Group N NOW 3.763 

EOS 4.660 

Overall Mean: NOW 4.072 

EOS 4.588 



In = 4 
2n = 7 
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TIME IN IRR 



Table D-5-6 provides a breakdown of CTM personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values, computed over all tasks of the rating, that were assigned for 
proficiency for 6-month intervals of IRR time, and for IRRs off active duty 
for more than 3 years. These mean values are shown for information only, 
since the number of individuals in each group is too small to permit 
meaningful quantitative interpretation. 

Table D-5-6 

Mean Proficiency Values for CTM IRR Respondents by Time Since EAOS 



Time (Mos.) 

Since EAOS Mean No. of Cases 



0-5 
6-11 

12-^7 

18-23 




36+ 3.91 10 

Overall Mean 3.98 11 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. 
Interpretations relating to CTM IRR service members are not warranted, 
however, because of the small number involved. Legitimate conclusions 
concerning skill deterioration and retraining needs cannot be made. 
Comments on the CTM IRR data base and on active duty data are provided 
however. 

COMMENTS ON DATA BASE 

Approximately 40 percent of questionnaires returned were classified as 
"nonvalid" (table D-5-1). This category reflects probable errors in the IRR 
data base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in Ifa», returned to active 
duty, already received final discharge. Retiree recruited from another 
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service, was never on active duty in the Navy." (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 1985). Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased." From the above data, it can be concluded that about 40 
percent of the CTM IRRs could not or would not be available for 
mobilization. 

Questionnaires were presumably delivered by the Postal Service to a 
number of CTMs (76 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those rited above— they 
felt the questionnaire was not applicable, A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the CTM 
IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that CTM respondents have oeen away from active duty; i.e., since EAOS. 
Table 0-5-6 shows that 91 percent (i.e., 10 out of 11) were in the IRR for 
more than 3 years. The reasons concerning why the data files did not 
contain many more IRR CTMs in the under 3 years since EAOS category should 
be determined. 3 

Two issues emerge from time considerations: (1) the need for skill 
upgrading and (2) availability of IRR members. Upgrade training because of 
new equipment, procedures, or material will probably be required for these 
CTMs, but CTM SMEs must make this determination, however, based on chanqes 
to how the job is now performed. 

A second consideration concerns the military service obligation (MS0). 
Those who are liable for a 6- or 8-year MS0 (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The actual size of the available IRR manpower pool may be overestimated. 
Again, the recommendation is made that this data base be reviewed and 
validated if this is not already occurring. 

TRAINING NEEDS 

An important concern of this study was with determining the need for 
training CTM IRR personnel to acceptable proficiency levels prior to a 
mobilization recall. Although skill deterioration could not be assessed 
data were obtained that define acceptable level of proficiency. The current 
proficiency levels reported by active duty personnel can be taken as E-4 
(CTM-3) criterion performance; they reflect the level of proficiency claimed 
by the average CTM-3 now on active duty. These data may be used to 
establish the goals for any type of training program and also for assessing 
skill loss if data, and opportunity, are subsequently provided. 
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For effective future use of the data, the meaning of specific numerical 
values reported for task means must be clearly understood to reach 
conclusions about skill deterioration or training. Attention is directed to 
the "answer key" shown on either table D-5-2 or D-5-3. The answer key shows 
that a value of "4," for example, represents skilled performance with only a 
need for occasional supervision. Following conventional practice, we assume 
that a "4" is reflected by any values between 3.50 and 4.49. A "3" is 
interpreted similarly. Thus, skill deterioration may be shown by lower mean 
values for NOW (i.e., current) versus EAOS proficiency. However, the change 
from EAOS scores may not be sufficient to move the IRR respondents to a 
lower proficiency category. For example, skill loss on tasks 7 to 9 
occurred for the IRRs working in a related field (see table D-5-5). 
However, the losses reported resulted in the IRRs remaining in the "4" 
category. We would conclude that the deterioration is of no consequence 
insofar as signaling a need for retraining. 

Assessment of the need for training reserve personnel against 
mobilization would proceed with the application of similar logic. In this 
case, the task mean values for "current" proficiency (i.e., after skill 
deterioration has occurred) of IRR personnel would be compared to the values 
for active duty (working in rating) personnel. If the values, in each case, 
fall into the same proficiency categories, a fair conclusion would be that 
training of IRRs would probably not be required before mobilization to bring 
proficiency to an acceptable level. 

An additional factor to consider in assessing needs for training, 
however, concerns time since EAOS. For IRRs who have been away from active 
duty for more than 3 years, skill upgrade training should be considered to 
respond to any technical changes (e.g., new equipment, materials, 
procedures) in the field. 



CONCLUSIONS 

1. Mobilization planners should be aware that the IRR CTM data base 
is much smaller than would be expected. 

r-ru 2 * Concl " si °ns concerning skill deterioration and training needs of 
CTM IRRs cannot be provided because of the small number of individuals that 
returned usable questionnaires. 

3. Data obtained from the active duty sample of CTM.-3s can be used to 
establish training programs for CTMs. They can also be used in future 
efforts to assess implications of skill loss information that may 
subsequently become available. 
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RECOMMENDATIONS 

1. Review, update, and validate the CTM IRR data base content to 
assure that accurate assessments of the size of the manpower pool are 
available at all times. Take whatever other steps are necessary and 
available to assure continuous updating of the data base. 
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2. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
schoolhouse SMEs adequately represent the CTM-3 job. Determine that the 
CTM-3 job is, in fact, acceptable as the target performance level for 
returning CTM IRRs. 

3. Consider recalling a sample of CTM IRRs to assess their knowledge 
of current CTM-3 job requirements. Use the data of this study as a baseline 
for decisions about skill loss and retraining needs. 
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APPENDIX D 



ANNEX 6 



CRYPTOLOGIC TECHNICIAN (COMMUNICATIONS) (CTO) 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 

Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel m;y 
voluntarily enlist in the IRR. IRft members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Cryptologic 
Technician (CTO) rating was one of these 16. 

PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum acceptable proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific rense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any training regimen should attempt to 
achieve. 

APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Five senior 
enlisted CTOs, assigned to the Naval Technical Training Cent t, Corry 
Station, Pensacola, FL, served as subject matter experts ,jME) for 
questionnaire development. Under guidance given by the project staff, the 
CTO SMEs selected from various source materials a set of job tasks that, in 
their judgment, best represented the job (non-NEC specific) of an active 
duty CT0-3. This level was chosen in the belief that a recalled ready 
reservist who could perform CTO job tasks competently at the E-4 level would 
make a positive work contribution to a receiving unit. 



D-6-3 



Technical Report 86-007 



The CTO-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty CT0-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty CTO-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of these data 
collection instruments are shown in the next section. 

As of 10 December 1984, 820 CTOs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN). Questionnaires were mailed under 
CNO (0P-11) cover letter on 21 February 1985 to a random sample of 500 (61 
percent). Coordination with the Commander, Naval Security Group 
(C0MNAVSECGRU) had previously been accomplished. Because of a low initial 
return rate, a follow-up mailing (336) was made on 8 April 1985. 
Questionnaire returns were accepted until 24 May 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CiNCPACFLT) , 
CGi NAVSECGRU, and within CNO (0P-01) was accomplished for authorization to 
survey active duty CiO-3 personnel. A CTO-3 roster, current as of 2 August 
1985, was obtained from NAVMILPERSCOM. From a pool of 515, a sample of 279 
CT0-3s was determined using accepted survey research methods. 
Questionnaires were mailed on 18 September 1985 under CNO (0P-11) cover 
letter to unit/activity commanding officers for distribution to CT0-3s 
named. Returns were accepted until 31 December 1985. Returned 
questionnaires were scanned to determine data usability, and data were 
entered into computer files. Subsequently, summaries of the information of 
interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of CT0 skill deterioration are 
presented in .is section. 
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QUESTIONNAIRE RETURN STATISTICS 

Table D-6-1 shows, f or both the IRR and active duty CTOs, the number of 
questionnaires mailed ar.d number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid returns (nonvalid principally because 
of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (14) by the number delivered (i.e., 500 - 127 = 



Table D-6-1 



Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


500 


114 


30.6 


127 25.4 


Active Duty 


279 


184 


65.9 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-6-2 for IRR personnel and in table D-6-3 for active duty personnel. 
The tables are modified questionnaire forms. 

Background Questions 

Of 112 IRR CTOs answering the question, 24 (approximately 21 percent) 
reported that they now work in a civilian occupation related to their Navy 
CTO rating. Answers to the -emaining two background questions for IRRs (see 
table D-6-2) are not reporteo since it was determined that the answers might 
be redundant and could not be unambiguously interpreted. Of the active duty 
respondents answering the background questions (see table D-6-3), 163 of 181 
(90 percent) work in rating. One hundred and forty-nine (82 percent) are 
assigned sea duty. 

Task Performance Data 

The data summary tables (D-6-2 and D-6-3) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
"1.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of data (r = .846, p< .05) 
indicated significant agreement between the two classes of respondents. 
Thus, tasks which have not been performed frequently by active duty CTOs (to 
date) are the same tasks that had not been performed frequently by IRRs at 
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Table 

Overall Summary of CTU 



PART 1: 



1. If necessary, correct your Service 
lumber. 

2. I* the work Which you do IOW related 
to your levy rating? 

Yet 24 lo JJL 

3. Have you done PREVIOUS work which ia 
related to your levy rating 

aince your Expiration of Active 
Obligated Service (BA03)T 

Tea - lo - 



IRR Questionnaire Data 



A1SUE1 KEY: 



(1) Have never performed the teak. 

(2) Can/could do simple parte of the teak 
(need direct tuperviaion) . 

(3) Can/could do moat parts of the teak 
(need general eupervision). 

(4) Can/could do ail parts of the task 
(need only occasional eupervieion. 
Meets minimum local speed and accuracy 
standards.) 



Have you received training related to (5) Can/could do complete task quickly and 
your levy rating since your Expiration accurately (need no eupervision). 

of Active Obligated Service (EAOS)T 
Yes lo - 



PART 2: 



For each job teak statement below: 

A. Indicate your CURRE1T level of ability according to the answer key above. 

B. Betlmate your PREVIOUS level of ability at the tie* of your EAOS according to 
the answer key above. 



"CD- Choices A B 

£ % Tasks 1 lean SD 1 Keen SD 

1 .9 1. Maintain operating logs, records, 113 3.97 1.089 111 4.83 .537 

and flies. 

4 3.6 2. Enter corrections to communlcatlone 114 3.83 1.221 112 4.57 .887 
publications. 

2 1.8 3. Account for, Handle, stow, transmit. 114 3.79 1.237 112 4.73 .600 

and dee troy cleat If led material. 

2 1.8 4. Change rlbbont, paper, and tape on 114 4.30 1.055 112 4.87 .577 
teletypewriter, adjust teleprinter 
controls to provide desired page or 
tape copy. 

1 .9 5. stand watch on teletypewriter 114 3.98 1.175 112 4.86 .551 
circuit . 

35 31.3 6. Operate atreanllner. 114 2.36 1.311 112 3.2 1.726 

34 31.8 7. Operate TAG 1ST EL. 109 2.39 1.312 107 3.44 1.760 
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Table D-6-2 (Continued) 



2 1.8 8. Pnpv* CUTIC, plaindreii, 112 2.84 1.143 111 4.68 .763 

abbreviated pJalndress, and 
address aossages in proper format; 
raad chad taps (SO characters par 
■louts). 

6 3.3 t. Prepare Messages in Of 8 COM format. 112 2.83 1.207 110 4.38 1.009 

39 34.3 10. Changs coablnatlon of thraa tuafcler 114 2.50 1.459 112 3.19 1.763 
and clphar type coafcinatioa 
locking devices 

8 8.0 11* Determine aaesage handling procaduras 114 3.16 1.232 112 4.31 1.193 
raquirad during minimise; prapara and 
deliver messages by physical 



21 19.3 12. Identify fundamentali of tha World- 113 2.38 1.230 108 3 33 1.330 
wide autodln Eestoral Flan. 

6 3.4 13. Oparata technical control equipment. 114 3.12 1.318 111 4.33 1.123 

14. t can/could type. 108 40wp a 17.118 112 51«pm 13.252 

Overall Mean: 3.23 



e 
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Table D-6-3 

Overall Summary of CTO Active Duty Questionnaire Data 



PAST 1: 



AISUER KEY: 



1. If necesssry, correct your Service 
lumber. 

2. Does your current billet require you 
to work In your Mavy rating? 

tee 163 So IB 

3. Whet type duty Is your current 
billet? 

8es 149 Shore 32 



(1) Heve never performed the task. 

(2) Can /could do simple parts of the task 
(need direct supervision). 

(3) Can/could do most parts of the task 
(need general supervision). 

(4) Can/could do all parts of the task 
(need only occasional supervision. 
Meets minimum local speed and accuracy 
standards.) 

(5) Can/could do complete teak quickly and 
accurately (need no supervision). 



PAST 2: 

For each job task statement below: 

A. Use the answer key above to indicate your CURRENT level of ability. 

B. Use the answer key above *o estimate your EXPECTED level of ability after 2 
years of nfit Performing these tasks. 



"(1)" Choices A B 

F % Tasks V Mean SD V Mean SD 

1 .5 1. Maintain ope atlng logs, records, 184 4.69 .642 177 3.83 .958 
and files. 

24 13.2 2. Enter corrections to coasminlcatlons 182 4.15 1.390 174 3.80 1.268 
publications. 

7 3.9 3. Account for, handle, stow, transmit, 181 4.49 .952 17* 3.70 1.061 
and destroy classified Material. 

4. Change ribbons, paper, and tape on 184 4.89 .329 178 4.30 .882 
teletypewriter, adjust teleprinter 
controls to provide desired page or 
tape copy. 

6 3.3 5. Stand watch on teletypewriter 184 4.68 .830 179 3.94 1.080 
circuit. 

85 47.2 6. Operste streamliner. 180 2.51 1.653 166 2.18 1.299 

86 46.1 7. Operate TACIMTEL. 164 2.60 1.693 169 k.28 1,350 
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1 .3 8. Prapara CRITIC, plalndrass, 184 4.14 .910 178 2.93 .997 

tUctvUUd plalndraat, and 
addratt aassagas La proper foraat; 
raad chad tapa (30 charactara par 
alouta). 

23 13.8 9. Frapara aaaaagaa in OPS COM foraat. 181 3.93 1.373 177 3.04 1.249 

90 48.9 10. Changa combination of thraa tunblar 184 2.47 1.822 189 2.24 1.387 
and ciphar typa combination 
locking davlcaa. 

21 11.3 11. DaUcmina aaatago hand ling procaduraa 183 3.73 1.342 17* 3.08 1.234 
raqulrad during ninimisa; prapara and 
dallvar aaaaagu by physical 



20 11.0 12. Idantlfy fund—antala of tha World- 182 3.48 1.248 177 2.83 1.132 
wida Autodln laatoral Plan. 

22 12.1 13. Oparata tactmlcal control aqulpnant. 183 3.39 1.393 177 2.81 1.227 

14. X can/could typa. 
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Tables D-6-2 and D-6-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SO) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR sample, table D-6-2, the "A" column 
reflects current average ability level; the "B" column, EAOS average ability 
level. For the active duty sample (table D-6-3), the "A" column refers to 
current (NOW) ability and the "B" to proficiency expected after 2 years of 
nonperformance of a task.l A Pearson Product Moment Correlation (r - .95/, 
p < .05) computed between task means for IRR EAOS and active Huty NOW 
(current proficiency) values indicates that the IRR members, while on active 
duty, performed job tasks at competency levels equivalent to those of 
current job incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the CTO-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where general supervision would be needed (mean = 3.2). 

For the active duty group, means reflecting proficiency on each job 
task for CTOs working/not working in their rating were computed. These are 
shown in table D-6-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-6-5 displays task proficiency means for two subgroups of the 
CTO IRR respondents: (1) those who answered that they were now working 
("W") in a field related to the Navy CTO rating and (2) those who indicated 
that they were not working ("N") in a related field. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-6-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key. These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-6-5, values 
preceded by a minus sign repr *ent a decrease in proficiency during IRR 
membership: current proficiency is less than EAOS proficiency. Values with 
no signs would indicate increases in proficiency. 

The table shows that, since EAOS, all CTOs lost proficiency on all job 
tasks. Although the differences are not large, CTOs who now work ("W") in a 
field related to their former active duty jobs reported less skill 
deterioration over all but one (task no. 1C) of the 13 rating tasks than the 
11 N" subgroup. Statistical tests (t tests for independent means; see 



iThese expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since it was clear that many respondents did not 
understand the question being asked. 
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Table D-6-4 

Task Mean Values for Two Subgroups of Active duty CTOs 

Not Working ("N") 1 Working ("W") 2 
Task NOW EXP NOW EXP 



1 4.556 3.500 4.722 3.890 

2 4.571 3.429 4.641 4.126 

3 4.471 3.588 4.649 3.834 

4 4.889 3.944 4.902 4.352 

5 4.611 3.500 4.822 4.071 

6 3.600 2.556 3.894 3.094 

7 2.750 2.333 4.111 3.278 

8 4.059 2.800 4.166 3.039 

9 4.111 2.900 4.428 3.376 

10 4.000 3.167 3.818 3.169 

11 3.933 2.929 4.117 3.396 

12 4.000 2.917 3.721 2.903 

13 3.600 2.714 3.946 3.142 



Composite Mean: Group W NOW 4.303 

EXP 3.513 

Group N NOW 4.089 

EXP 3.098 

Overall Mean: NOW 4.196 

EXP 3.306 



In = 18 
2 n = 163 



ERIC 



D-6-11 



174 



Technical Report 86-007 



Table D-6-5 

Task Mean Values for Two Subgroups of IRR CTOs 





Not Working ("N") 1 


Working ("W") 2 


Mean 


ui t T erence 


Task 


NOW 


EAOS 


NOW 


EAOS 


"N" 




i 
i 


3.966 


4.849 


4.571 


4.913 


U • OO 0 




o 
L 


3 919 


4.741 


4.286 


4.591 


n M? 
- u . occ 


-n in** 


3 


4.024 


4.793 


4.053 


4.500 


-0.769 


-0.447 


A 


4.356 


4.953 


4.682 


4.87' 


n ^Q7 


n l a a 
- u • xoo 


5 


4 0Q1 


4 897 


4.421 


4 870 


-0.806 


-0.449 


0 


2.930 


4.155 


3.813 


4.579 




-fi 7fifi 


7 


3.086 


4.596 


3.308 


4.500 




1 1Q9 


p 
o 


2.963 


4.729 


3.368 


4.826 




-1 45 A 


9 


3.175 


4.790 


3.333 


4.682 


-1.615 


-1.449 


10 


3.368 


4.333 


3.400 


4.438 


-0.965 


-1.038 


1 1 


3.275 


4.582 


3.905 


4.696 


-i. oU/ 


n 7Qi 
-u./yi 


12 


2.937 


4.194 


3.059 


4.048 


-1.257 


-0.989 


13 


3.244 


4.464 


4.294 


4.850 


-1.220 


-0.556 






Composite Mean: 


Group W 


NOW 3.884 














EOS 4.643 












Group N 


NOW 3.487 














EOS 4.621 










Overall Mean: 




NOW 3.686 







EOS 4.632 



In = 88 
2n = 24 
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Guilford and Fruchter, 1973) indicated that over all tasks of the CTO 
rating, the proficiency of the two subgroups was equivalent at EAOS 
(t s .2228, £< .4128). Task mean proficiency values differed significantly 
(t * 1.92, £<.0334) on current (NOW) proficiency. 

TIME IN IRR 

Table D-6-6 provides a breakdown of CTO personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
IRRs off active duty for more than 3 years. These mean values are shown for 
information only, since the number of individuals in each group is too small 
to permit meaningful quantitative interpretation. 



Table D-6-6 



Mean Proficiency Values for CTO IRR Respondents by Time Since EAOS 



Time (Mos.) 
Since EAOS 


Mean 


No. of Cases 


0-5 


3.72 


3 


6-11 






12-17 






18-23 






24-35 


3.47 


4 


36+ 


3.20 


98 


Overall Mean 


3.23 


105 



C0H4ENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rate coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful i nf ormat ion about the I RR that has not been avai 1 abl e 
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previously. They also suggest directions that should be taken with respect 
to the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

Approximately 25 percent of questionnaires returned were classified as 
M nonvalid M (table D-6-1). This, category reflects probable errors in the IRR 
data base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: M No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from another 
service, was never on active duty in the Navy." (All information concerning 
such cases was transmi tted to the Naval Reserve Personnel Center on 26 
September 1985). Finally, a very few questionnaires were retirnprf by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased. 41 From the above data, it can be concluded that about 25 
percent of the CTO IRRs could not or would not be available for 
mobilization. 

Questionnaires were presumably delivered by the Postal Service to a 
number of CTOs (69 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above— they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the CTO 
IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that CTO respondents have been away from active duty. This information 
is given in table D-6-6. By extrapolation, only 7 percent of the CTOs were 
in the IRR for 3 years or less. A greater number would have been expected. 
The reasons for this small number should be determined. 

Two issues emerge from time considerations: (1) the need for skill 
upgrading and (2) availability of IRR members. Upgrade training because of 
new equipment, procedures, or material will probably be required for the 93 
percent of CTOs who have been in the IRR more than 3 years. 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the pool of manpower available may be overestimated. In the CTO 
case, there is the additional consideration of the very small number of 
individuals in the IRR files who were listed as being away from active duty 
for 3 years or less. A greater number would be expected given MSO 
requirements. Again, the recommendation is made that the IRR data base be 
reviewed and validated. 



Technical Report 86-007 



SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-6-5. In table D-6-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 21 percent of CTO IRRs reported that they now work in a 
civilian occupation related to the CTO rating, and the effects of this work 
experience on skill deterioration will be considered next. As table D-6-5 
shows, those who now work ("W") in a related field reported less skill 
deterioration than the M N M subgroup for all but one of the 13 job tasks. 
Taken over all tasks, differences between the current (NOW) proficiency 
means for the two subgroups were statistically significant. Also, they 
could not be attributed to initial differences between the groups at EAOS. 
Thus, civilian CTO-related employment significantly affected skill 
deterioration. Those continuing to work in the field after EAOS reported 
less deterioration. The tasks on which the greatest amount of skill 
deterioration occurred are easily identifiable from table D-6-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to mooi lization. Thus, the implications of 
skill deterioration data must be assessed against the criterion of 
acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by CTO IRRs against the 
levels reported by active duty CT0-3s. in* task means for the active duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average CTO-3 now on active duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either table D-6-2 or D-6-3. The answer key shows that a value of 
M 4, M for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
"4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
proficiency category. For example, skill loss occurred on task 3 for all 
IRRs (see table D-14-5). However, the losses reported resulted in the IRRs 
remaining in the "4 M category (see table D-6-5). We would conclude that the 
deterioration is of no consequence. 

Assessment of the need for training IRR personnel against mobilization 
should proceed with the application of similar logic. Table D-6-7 below 
presents the task mean values reported for current (NOW) proficiency by IRR 
personnel who are not working in a field related to the CTO rating and also 
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for those who are working in a related field. These values are from table 
D-6-5. TasK proficiency means for active duty personnel working in their 
rating (taken from table D-6-4) are also shown in table D-6-7. Inspection 
of the data shows considerable variation in the mean values. Assuming that 
CTO IRR returnees should exhibit essentially the same proficiency (i.e., be 
in the same proficiency category) a* active duty personnel, we conclude that 
training prior to mobilization should occur for at least the tasks indicated 
(*) in the table. 



Table D-6-7 

Task Mean Proficiency Values for IRR and Active Duty CTOs 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


\ 


4.0 


4.6 


4.7 


2 


3.9 


4.3 


4.6 


3 


4.0 


4.1 


4.6 


4 


4.4 


4.7 


4.9 


5 


4.1 


4.4 


4.8 


6 


2.9* 


3.8 


3.9 


7 


3.1* 


3.3* 


4.1 


8 


2.9* 


3.4* 


4.2 


9 


3.2* 


3.3* 


4.4 


10 


3.4* 


3.4* 


3.8 


11 


3.3* 


3.9 


4.1 


J.2 


2.9* 


3.1* 


3.7 


13 


3.2* 


4.3 


3.9 


14 








♦Probable training need. 







From our assessment, the current level of proficiency of CTO IRRs on 
some job tasks is probably adequate. Retraining and/or maintenance training 
prior to a mobilization recall should be considered for the tasks shown in 
the table, however. For tasks not starred (*), a modicum of 
^familiarization at mobilization will probably suffice to restore lost 
skill. This could probably be given by close, corrective supervision while 
the returnee is performing job tasks. This conclusion js especially 
relevant to the IRR CTOs who continue to work in a related occupation. 

An additional factor to consider in assessing needs for CTO training 
concerns time since EAOS. Ninety-three percent of he CTO IRRs were away 
from active duty for more than 3 years (see table D-6-6). Subject .natter 
expert; who review the data provided here will probably determine that skill 
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upgrade training is also required because of technical changes {<>.<k, r, 
equipment, materials, procedures) in the field. All in all, based 01 ■ 
is known of the CTO 1RR manpower base, our principal recommendation i tn . 
formal training be considered for this group of reservists. This trainm-i 
should occur prior to mobilization. Given the classified nature of Lhe CI\> 
job, training should be developed and implemented at the CTO "A" School 
using a premobilization curriculum. Training emphasis should be on the 
tasks identified in table D-6-7. 

VALIDATION OF DATA 

Our analyses indicate that there is a need for training CTO IRRs 
against mobilisation requirements. It would appear that required 
proficiency (i.e., the level shown by current job incumbents) can be 
achieved by familiarization training under direct corrective supervision for 
only a few job tasks. Principally because of the long time periods since 
EAOS, we feel *hat comprehensive retraining for most rating tasks, such as 
would be provided in a formal school setting, is needed. Information not 
readily available to the project staff is required, however, for firm 
decisions about the type and amount of training needed. Me also recommend 
that the information provided by this report be evaluated/validated against 
certain other considerations. Resource sponsors would be appropriate to 
validate training needs. 

Data Review 

As noted previously, the conclusions generated y the project staff are 
considered tentative and subject to verification. Generalizations from the 
data are limited because of the small numbers of questionnaires returned and 
because of suspected IRR data base inadequacies. It is believed, however, 
that much useful information can be gleaned from the descriptive summaries 
provided. Most of this information has not previously been available 
because of the many difficulties inherent in conducting skill deterioration 
research and restrictions on methods that can be used because of practical 
considerations. Maximum exploitation of the information that is now 
available is in order. A complete and accurate assessment of the meaning 
and action implications of the data should be made by individuals who are 
thoroughly knowledgeable of technical requirements of the CTO rating. The 
NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to be 
considered in the review/validation process are discussed next. 

Review Areas 

For our study, SMEs from the CTO "A" School at Corry Station, 
Pensacola, FL, identified the jcb tasks they thought would be appropriate 
for returning IRR CTO members to perform. Other SMEs may not agree on the 
list. Resource sponsors should determine if these are indeed the job tasks 
that an IRR returnee (at mobilization) should be able to perform. Further, 
a companion aecision is required concerning the acceptability of the 
reported level of competency. Since active duty personnel report that they, 
on the average, now perform at these levels, the data reflect E-4 criterion 
performance. Resource sponsors should consider whether less proficiency 
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would be acceptable. If so, attendant training requirements for IRRs with 
concomittant resource requirements would be lessened. On judging tne need 
for training, task critical ity, in terms of personnel or equipment safety, 
or mission success, as it interacts with recent changes to material, 
procedures, or equipment, must also be considered. 

An viditional decision factor concerns plans for utilization of CTO IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, some of thi s 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, however, based on 
available data that "desired" proficiency on many job tasks can only be 
achieved through formal training. Tasking of the Naval Technical Training 
Center, Corry Station, to develop a premobilization curriculum for CTOs 
should be considered. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the CTO IRR 
manpower pool may bf. smaller than believed. Approximately 25 percent of the 
pool may not be contactable by mail. An additional segment of unknown size 
may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage of CTOs listed in IRR files could also be 
beyond the zone of involuntary recall. 

2. CTO IRR personnel who work in civilian occupat'ons related to 
their Navy rating reported less deterioration of skills than CTOs not 
similarly employed. This group should be considered for first ^ecall 
priority. 

3. Refresher and maintenance training for all CTOs appears necessary 
prior to mobilization for many job tasks. Familiarization training at 
recall consisting of supervised practice may suffice for other tasks. This 
conclusion is subject to concurrence by subject matter expert CTOs. 

4. Ninety-three percent of the CTO personnel in this sample were away 
from active duty for greater than 3 years. This group will undoubtedly 
require premobilization training to update skills. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the CTO IRR manpower pool are 
available at all times. Take whatever other steps are necessary and 
available to assure continuous updating of the data base. 
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I. Amend existing procedures where possiole >o obtain «nn.>, u 
from Ii\K members concerning civilian employment. At the very ]eaA, on\ i.< 
this information from those eligiDle for or receiving bonuses for contin'i" •• 
IRR service. Consider these individuals as first choice for mobil i/ai.irn. 
recall. 

3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
schoolhouse SMEs adequately represent the CTO-3 job. Determine that the 
CTO-3 job is, in fact, acceptable as the target performance level for 
returning CTO IRRs. Request resource sponsors consider the data against 
factors such as changes to materials, procedures, equipment used by the 
rating, criticality of task performance, and mobilization plans for IRR 
personnel . 

4. Consider recalling a sample of CTO IRRs to assess their knowledge 
of current CTO-3 job requirements. Use this information to validate the 
data and conclusions of this study. 

5. Task the NAVTECHTRACEN, Corry Station, to develop a 
premobilization curriculum for refrehser training of CTO IRRs. Use data 
provided from this study to identify training emphases and, also, 
requirements for inclusion of instructional modules for skill upgrade 
training. 

6. Task the NAVTECHTRACEN, Corry Station, to develop a CTO skill 
maintenance training program for IRR CTOs. 
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CRYPTOLOGIC TECHNICIAN (COLLECTION) (CTR): 

SKILL DETERIORATION DURING NAVY 
INDIVIDUAL REAPY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve ( IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist i n the IRR- IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The stu^y 
was performed at the request of the Chief of Naval Operations (0P-01R1), 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Cryptologic 
Technician (Collection) (CTR) rating was one of these 16* 



PURPOSE OF THE STUDY 



The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training Ik* personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum acceptable proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any training regimen should attempt to 
achieve. 



APPROACH 



Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Six senior 
enlisted CTRs, assigned to the Naval Technical Training Center, Corry 
Station, Pensacola, FL, served as subject matter experts (SME) for 
questionnaire development. Under guidance given by the project staff, the 
CTR SMEs selected from various source materials a set of job tasks that, in 
their judgment, best represented the job (non-NEC specific) of an active 
duty CTR-3. This level was chosen in the belief that a recalled ready 
reservist who could perform CTR job tasks competently at the E-4 level would 
make a positive work contribution to a receiving unit. 
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The CTR-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty CTR-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty CTR-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of these data 
collection instruments are shown in the next section. 

As of 10 December 1984, 865 CTRs were listed in Naval Military 
Personnel Command (NMPC) computer files as assigned to the IRR. Names and 
addresses were obtained from NMPC through the Naval Reserve Personnel Center 
(NRPC). Questionnaires were mailed under CNG (0P-11) cover letter on 21 
February 1985 to a random sample of 500 (61 percent). Coordination with the 
Commander, Naval Security Group (C0MNAVSECGRU) had previously been 
accomplished. Because of a low initial return rate, a follow-up mailing 
(336) was made on 8 April 1985. Questionnaire returns were accepted until 
24 May 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT) , 
C0MNAVSECGRU, and within CN0 (OP-01) was accomplished for authorization to 
survey active duty CTR-3 personnel. A CTR-3 roster, current as of ? August 
1985, was obtained from NMPC. From a pool of 422, a sample of 27* CTR-3s 
was determined using accepted survey research methods. Questionnaires were 
mailed on 18 September 1985 under CNO (0P-11) cover letter to unit/activity 
commanding officers for distribution to CTR-3s named. Returns were accepted 
until 31 December 1985. Returned questionnaires were scanned to determine 
data usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

Unfortunately, questionnaires intended for CTR active duty personnel 

were inadvertently mailed to active duty Cryptologic Technician (Technical) 

(CTT) personnel. Because of rating job similar .ties, much of the data were 
still usable and are appropriately reported. 



Results pertinent to the assessment of CTR skill deterioration are 
presented in this section. 



RESULTS 
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QUESTIONNAIRE RETURN STATISTICS 

Table D-7-1 shows, for both the IRR and active duty CTRs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid returns (nonvalid principally becaucv 
of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (91) by the number delivered (i.e., 500 - 153 = 
347). 

Table D-7-1 



Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


500 


91 


26 


153 30.6 


Active Duty 


271 


177 


65 





QUESTIONNAIRE OATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-7-2 for IRR personnel and in tables D-7-3a and D-7-3b for active 
duty personnel. The tables are modified questionnaire forms. 

The data presented in table D-7-3a are from active duty CTT personnel. 
As mentioned, the CTR questionnaire was inadvertently mailed to CTTs. This 
table shows how CTTs responded to CTR tasks. It is presented for 
information only. The data are not used in subsequent analyses to assess 
skill deterioration or training needs. 

The data given in table D-7-3b are from active duty CTRs. Data are 
available for only six tasks, however. These tasks were common to both CTTs 
and CTRs and were included on both questionnaires. 

Background Questions 

Of 91 IRR CTRs answering the question, 10 (approximately 11 percent) 
reported that they now work in a civilian occupation related to their Navy 
CTR rating. Answers to the remaining two background questions for IRRs (see 
table D-7-2) are not reported since it was determined that the answers might 
be redundant and could not be unambiguously interpreted. Of the active duty 
respondents answering the background questions (see table D-7-3b), 159 of 
175 (90.9 percent) work in rating. One hundred and fifty-nine (92 percent) 
are assigned sea duty. 
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Table D-7-2 

Overall Sunamary of CTR IRR Questionnaire Data 



FAIT <! 



ABSWBR KEY: 



1. If necessary, correct your Strvlce 



3. 



It the work which you do WW related 
to your navy ratlngf 

x— 1Q So jl 

Hw you done ravious work which is 
related to your navy rating 
sines your Expiration of Aetlv* 
Obligated service (BA08)T 

Too s Bo - 

Have you rocalvod training roiatod to 
your Bevy rating since your Expiration 
of Active Obligated Service (KAOS)T 
Yes - Bo - 



(1) Have novor performed tho took. 

(2) Can/could do ainplo parts of tho took 
(naod diroct suporvioion). 

(3) Can/could do noot pacta of tho took 
(naod genera?, supervision). 

(4) Can/could do oil parts of tho task 
(naod only occasional supervision. 
Meets nininun local speed and accuracy 
standards.) 

(5) Can/could do complete task sulckly and 
accurately (need no supervision) . 



PAST 2: 



For each Job task statement below: 

a. Indicate your CUBUBT level of ability according to the ansvsr above. 

B. Estimate your PBSV10U8 level of ability at the tins of your EA08 according to 
ths answer key above. 



-(1)- Choices A B 



E 


% 




Tasks 


B 


Mean 


80 


B 


Mean 


SO 


17 


19.1 


1. 


Perform basic analysis using 
publications and working aids. 


91 


2.45 


1.214 


89 


3.62 


1.585 


27 


30.7 


2. 


Identify HI J I (Beaconing, Inter- 
ference, Jasmin* , and Intrusion) 
signals. 


SO 


2.47 


1.432 


88 


3.23 


1.727 


3 


3.4 


3. 


Properly account for* handle, stow, 
and destroy classified material. 


89 


3.75 


1.255 


87 


4.35 


1.078 


1 


1.1 


4. 


Perform Morse code collection duties: 
recognise common non-morse and B/T 
select lone. 


91 


3.53 


1.288 


89 


4.51 


.919 


7 


8.0 


5. 


mecogniae and report CBITIC activity. 


90 


2.99 


1.302 


88 


4.07 


1.294 


3 


3.4 


a. 


Operate and calibrate the 1-3 to. 


91 


3.81 


1.349 


89 


4.57 


.999 


50 


5B.1 


7. 


Operate and calibrate the 1-2174. 


87 


1.93 


1.388 


8* 


» 31 


1.889 
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62 71*3 8* Oparata and calibrate the S8Q 80 87 1.51 .975 87 1.87 1.495 

mult: 

29 33.0 9* Oparata coaputar-baaad collation 89 2.52 1*478 88 3.18 1*726 



32 37*2 10* Parfom FLAG and TAG function* 89 2.15 1*319 86 2*93 1*741 
IAU ZAXS OOm raqulraaanta* 

30 34*9 11* On 800L card data to lntarcapt 88 2*49 1,539 84 3,15 1.786 
appropriata targat. 

12, X can/could copy floraa coda* 77 17%/m 8.549 88 30g/« 10*15 

Ovarall Maan: 2.68 
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Overall Summary of CTR Active Duty Questionnaire liata 



PAST 1: 



1. If necessary, correct your Service 
lumber. 

2. Does your current billet require you 
to work in your levy rating? 

Yes 139 So U 

3. What type duty is your current 
billatT 

Sea 139 Shore 14 



AISUSK XMX: 



(1) Have never performed the task. 

(2) Can/could do simple parts of the task 
(need direct supervision). 

(3) Can/could do most parts of the task 
(need general supervision). 

(4) can/could do all parts of the task 
(need only occasional supervision. 
Meets minimum local speed and accuracy 
standards.) 

(3) Can/could do complete task quickly and 
accurately (need no supervision). 



PAR 2: 

Por each job task statement below: 

A. Use the answer key above to indicate your CUBVST level of ability. 



B. Use the answer key above to estimate your tXPCCTSD level of ability after 2 
years of not performing these tasks. 



"(1)" Choices 






A 






B 


E 


% 




Tasks 


i 


mean 


8D 


S 


he an 


23 


13.1 


I. 


Perform basic analysis using 
publications and working aids. 


174 


3.79 


1.372 


174 


2.94 


102 


5S.0 


2. 


Identify HIJI (Beaconing, Inter- 
ference, Jamming , and Intrusion) 
signals. 


174 


2.10 


1.431 


170 


1.93 


5 


2*S 


1. 


Properly account for, handJt, stow, 
and destroy classified met' rial. 


174 


4.19 


1.024 


174 


3.44 


25 


14.2 


4. 


Perform morse code collection duties; 
recognise common non-morse and t/T 
selections. 


174 


3.37 


1.359 


173 


2.4S 


40 


22.4 


5. 


lecognise end report CRITIC activity. 


177 


3. IS 


1.4SS 


172 


2.47 


13 


S.5 


4. 


Operate and calibrate the R-390. 


174 


3.72 


1.331 


174 


3. OS 


100 


37.1 


7. 


Operate and calibrate the 1-1174. 


175 


2.39 


1.731 


170 


2.20 
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146 83.0 8. Oparate end calibrate tha 88Q 80 176 1.34 .839 167 1.40 .865 

suite. 

21 12.0 9. Operate coejputer-baaed collection 175 3.96 1.383 171 3.28 1.223 
eyatew. 

131 74.9 10. Perform PLaO and TAG function* 175 1.65 1.263 168 1.58 1.017 

UM X4T8 com requirements. 

147 84.5 11. On 8COL card data to intercept 174 1.43 1.088 165 1.44 1.008 

appropriate target. 

12. 1 can/could copy aorta code. 
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Table t)-7-3b 

Overall Summary of Available CTR Active Duty Questionnaire Data 



PAST 1: 



AMtfUER KEY: 



1. If ntcuiirx, correct your Service 



2. Does your current billet require you 
to work in your Mavy rating? 

Yes 159 Wo It 

3. Whet type duty is your current 
billet? 

Sea Shore 



(1) Have never performed the task. 

(2) Can/could do simple parte of the task 
(need direct supervision) . 

(3) Can/could do most ports of the task 
(need general supervision). 

(4) Cen/couid do all parts of the task 
(need only occasional supervision. 
Meets minimum local speed and accuracy 
standards.) 

(5) Can/could do complete task quickly and 
accurately (need no supervision). 



PART 2: 

Por each Job teak statement below: 

A. Use the answer key above to indicate your CUI1DT level of sbility. 

B. Use the answer key above to estimate your KXPtCTID level of sbility after 2 
years of no£ performing these tasks. 



**(1) M Choices 
P * 



Tasks 



27 17.3 1. Perform baaic analysis using 
publications and working aide. 

19 12.3 2. Identify HXJI (heaconlng, Inter- 
ference* Jamming, and Intrusion) 
signals. 



V Keen SD If Mean SD 
151 3.53 1.439 150 2. $6 1.253 

155 3 . 52 1 . 350 148 2 . 89 1 . 194 



4 3.8 3. Properly account for. handle, stow. 157 4.2* 1.047 151 3.S7 1.219 
and destroy classified material. 

8 5.2 4. Perform Morse code collection duties; 155 4.03 1.101 149 3.32 1.229 
recognise common non-Morse and t/T 
selections. 

14 9.0 5. tecognize end report C1ITIC activity. 154 3.71 1.274 150 3.09 1.300 
4. Operate and calibrate the 1-390. 
7. Operate and calibrate the 1-1174. 
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Table D-7-3b (Continued) 



8. Operate and calibrate the SSQ 80 
auita. 



en tea*. 

10. Perform FLAG and TAG functional 
IAH TATS com rt^yirtmnts. 

11. On BOOL card data to intarcapt 
appropriate target. 

12. X can/could cop/ Horea coda. 



18 11.5 



Operate coaauter-baaed collection 



154 



3.74 1.330 147 



3.12 1.255 
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Task Performance Data 

The data summary tables (D-7-2 and D-7-3b) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
"l.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. 

Tables D-7-2 and D-7-3b also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SD) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR sample, table D-7-2, the "A" column 
reflects current average ability level; the "B" column, EAOs average ability 
level. For the active duty sample (table D-7-3b), the "A" column refers to 
current (NOW) ability and the "B" to proficiency expected after 2 years of 
nonperformance of a task.* 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the CTR-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform most tasks of the 
rating at a level where general supervision would be needed (mean = 2.7). 

For the active duty group, means reflecting proficiency on each job 
task for CTRs working/not working in their rating were computed. These are 
shown in table D-7-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-7-5 displays task proficiency means for two subgroups of the 
CTR IRR respondents: (1) those who answered that they were now working 
( M W") in a field related to the Navy CTR rating and (2) those who indicated 
that they were not working ("N") in a related fie'd. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-7-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key. These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-7-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 
membership: current proficiency is less than EAOS proficiency. Values with 
no signs indicate increases in proficiency. 



^These expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since it was clear that many respondents did not 
understand the question being asked. 
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Table D-7-4 

Available Task Mean Values tor Two Subgroups of Active Duty CTRs 



Not Working ("N" ) Working ("W") 



Task NOW EXP NOW EXP 



1 4.286 3.571 4.034 3.200 

2 3.714 3.000 3.865 3.157 

3 4.625 3.625 4.350 3.746 

4 4.429 3.429 4.168 3.488 

5 4.250 3.750 3.962 3.380 

6 ... 

7 - - 

8 - - 

9 4.250 3.250 4.102 3.496 



Composite Mean:* Group W NOW 

EXP 

Group N NOW 
EXP 

Overall Mean:* NOW 

EXP 



*These values were not computed for this rating. 



!n = 8 
2 n = 147 
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Task Mean Values for Two Subgroups of IRR CTRs 





Not Working ("N") 1 


Working 


/ nt in \ 2 
( "W" ) 


Mean 


Difference 


Task 


NOW 


EAOS 


NOW 


EAOS 


"N" 


"W" 


1 


3.100 


4.317 


3.400 


3.667 


-1.217 


-0.267 




3.327 


4.222 


J. COK) 


A 1 A *3 




rv on 0 


3 


3.787 


4.473 


4.600 


4.400 


-0.686 


C.200 


A 
H 


3.600 


4.513 






-fi Q1 7 


n Tfifi 


5 


3.194 


4.310 


4.200 


4.500 


-1.116 


-0.300 


6 


3.959 


4.658 


4.700 


5.000 


-0.699 


-0.300 


7 


3.226 


4.061 


5.000 


5.000 


-0.835 


0.000 


8 


2.762 


3.957 


3.333 


5.000 


-1.195 


-1.667 


9 


3.396 


4.278 


3.857 


4.000 


-0.882 


-0.143 


10 


3.071 


4.083 


3.500 


4.000 


-1.012 


-0.500 


li 


3.478 


4.260 


3.833 


4.667 


-0.782 


-0.834 






Composite Mean: 


Group W 


NOW 4.016 







EOS 4.471 

Group N NOW 3.355 

EOS 4.285 

Overall Me;n: NOW 3.685 

EOS 4.378 



l n = 81 
2n = 10 
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The table shows that CTRs who now work ("W") in a field related to 
their former active duty jobs lost proficiency on 9 or ii job tasks. This 



yroup also reported less skill deterioration over most other rating tasks 
than the "N" subgroup. Statistical tests (t tests for independent means; 
see Guilford and Fruchter, 1973) indicated that over all tasks of the CTR 
rating the proficiency of the two subgroups was equivalent at EAOS 
(t = 1.20, .1213). Task mean proficiency values differed significantly 
(t = 3.11, £<.O028) on current (NOW) proficiency. 

TIME IN IRR 



Table D-7-6 provides a breakdown of CTR personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time and for 
IRRs off active duty more than 3 years. These mean values are shown for 
information only, since the number of individuals in each group is too small 
to permit meaningful quantitative interpretation. 

Table D-7-6 

Mean Proficiency Values for CTR IRR Respondents by Time Since EAOS 



Time (Mos.) 

Since EAOS Mean No. of Cases 



0-5 


1.97 


7 


6-11 






12-17 






18-23 






24-35 


3.12 


7 


36+ 


2.71 


66 


Overall Mean 


2.68 


80 



COMMENTS AND OBSERVATIONS 



ERIC 



Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rate coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 
previously. They also suggest directions that should be taken with respect 
to the management and utilization of the IRR resource. 
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COMMENTS ON DATA BASE 

Approximately 31 percent of questionnaires returned were classified as 
"nonvalid" (table D-7-1). This category reflects probable errors in the IRR 
data base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from another 
service, was never on active duty in the Navy." (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 1985). Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased." From the above data, it can be concluded that about 31 
percent of the CTR IRRs could not or would not be available for 
mobilization. 

Questionnaires were presumably delivered by the Postal Service to a 
number of CTRs (74 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above—they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the CTR 
IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that CTR respondents have been away from active duty. This information 
is given in table D-7-6. Nearly 83 percent were in the IRR for more than 3 
years. Two issues emerge: (1) the need for skill upgrading and (2) 
availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group. CTR SMEs must make 
this determination, however, based on changes to how the job is now 
performed . 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. This should include an attempt to determine 
why so few CTRs were in the IRR group separated less than 3 years. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-7-5. In table D-7-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 
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Approximately 11 percent of CTR IRRs reported that they now work in < 
civilian occupalion related to the CTR rating and the effects of this dor* 
experience on skill deterioration will be considered next. As table D-7-tj 
shows, CTRs who now work in a field related to their Navy rating gained 
proficiency on one job task. This "W" subgroup also reported less skill 
deterioration than the "N" subgroup for 7 of the other 11 CTR job tasks. 
Taken over all tasks, differences between the current (NOW) proficiency 
means for the two subgroups were statistically significant. Also, they 
could not be attributed to initial differences between the groups at EAOS. 
Thus, civilian CTR-related employment significantly affected skill 
deterioration. Those continuing to work in the CTR field after EAOS 
reported less deterioration. The tasks on which the greatest amount of 
skill deterioration occurred are easily identifiable from table D-7-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to mobilization. Thus, the implications of 
skill deterioration data must be assessed against the criterion of 
acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by CTR IRRs aga'nst the 
levels reported by active duty CTR-3s. The task means for the act ve duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average CTR-3 now on active duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either table D-7-2 or D-7-3. The answer key shows that a value of 
"4," for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
"4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
proficiency category. For example, skill loss on tasks 9 to 11 occurred for 
the IRRs working in a related field. However, the losses reported resulted 
in the IRRs remaining in the "4" category (see table D-7-5). We would 
conclude that the deterioration is of no consequence insofar as signaling a 
need for retraining. 

Assessment of the need for training IRR personnel to support 
mobilization should proceed with the application of similar logic. Table 
D-7-7 below presents the task mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the CTR rating 
and also for those who ,:re. These values are from table D-7-5. Task 
proficiency means for active duty personnel working in their rating (taken 
from table D-7-4) are also shown in table D-7-7. Inspection of the data 
snows that 8 of the 11 job tasks are essentially "4"s for IRR CTRs working 
in a related field. For IRR CTRs not working in a related field, 4 of the 
11 job tasks are "4"s. Hence, from these data alone, a fair conclusion is 
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that training of CTR IRRs working in a related field would not be required 
before mobilization to bring proficiency to an acceptable level. On the 
other hand, training of CTR IRRs not working in a related field would be 
recommended before mooilization. 

From our assessment, there is no apparent need for extensive retraining 
or maintenance training of CTRs now working in the field. The data indicate 
that the average IRR CTR in this category should be able to perform required 
job tasks at an appropriate level of competency with a modicum of 
refamiliarization at mobilization. The picture is different for CTR IRRs 
not working in the field. The average IRR CTR can not oe expected to be 



Table D-7-7 

Task Mean Proficiency Values for IRR and Active Duty CTRs 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


1 


3.1* 


3.4* 


4.0 


2 


3.3* 


3.3* 


3.9 


3 


3.8 


4.6 


4.4 


4 


3.b 


4.5 


4.2 


5 


3.2* 


4.2 


4.0 


6 


4.0 


4.7 




7 


3.2* 


5.0 




8 


2.8* 


3.3* 




9 


3.4* 


3.9 


4.1 


10 


3.1* 


3.5 




11 


3.5 


3.8 




♦Probable training needs. 







able to perform required job tasks at mobilization. Due to the nature of 
tne CTR job, tasking should be issued to the appropriate CT community to 
develop a specialized premobi lization curriculum for the rating. 

For a number of reasons, even though the data reviewed above might 
indicate otherwise, we would also recommend formal refresher training for 
the CTRs who are working in jobs related to their rating. These reasons 
stem from the intrinsic nature of the CTR job and the limitations of most 
civilian employment for providing practice opportunities on the many aspects 
of this jo*3. For those relatively few IRR CTRs who are in civilian jobs 
related to the rating, training requirements would certainly be less than 
for the remaining IRRs. 

Any premobi lization curriculum developed for CTRs should consider the 
findings of research literature that reacquisition of lost skills requires 
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about one-half the time required to acquire these skills originally. Al ..>, 
a premobi 1 ization curriculum should be flexible enough to accoiiuiodul • 
specific training needs of individual CTRs. The tasks identified in tablo 
0-4-7 should be appropriately emphasized in the curriculum. Training for 
both basic and operational skills must be considered. 

An additional factor to consider in assessing needs for training 
concerns time since EAOS. Almost 83 percent of the CTR IRRs in the sample 
were away from active duty for more than 3 years (see table D-7-6). Subject 
matter experts who review the data provided here may determine that skill 
upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. These needs could also be 
incorporated into a specialized curriculum. 



VALIDATION OF DATA 



Our analyses indicate that there is a need for training CTR IRRs to 
support mobilization. Formal refresher training appears to be the best 
solution. In some cases, instructional modules for training prospective CTR 
returnees on given individual tasks may suffice. Information not readily 
available to the project staff is needed, however, for firm decisions about 
the need for training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the information provided by this report be 
evaluated/validated against a number of other considerations. Resource 
sponsors would be appropriate to validate training needs. 

Data Review 



As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the CTR 
rating. The NAVTRASYSCEN, if requested, could assist SMEs in this effort. 
Areas to be considered in the review/validation process are discussed next. 

Review Areas 



For our study, SMEs from the Naval Technical Training Center, Corry 
Station, Pensacola, Fl, identified the job tasks they thought would be 
appropriate for returning IRk CT nembers to perform. Other SMEs may not 
agree on the list. Resource spo ^rs should determine if these are indeed 
the job tasks that an IRR returnee (at mobilization) should be able to 
perform. Further, a companion decision is required concerning the 
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acceptability of the reported level of competency. Since active duty 
personnel report that they, on the average, now perform at these levels, 
these data reflect E-4 criterion performance. Resource sponsors should 
consider whether less proficiency would be acceptable. If so, attendant 
training requirements for IRRs with concomittant resource requirements would 
be lessened. On judging the need for training, task critical ity, in terms 
of personnel or equipment safety, or mission success, as it interacts with 
recent changes to material, procedures, or equipment, must also be 
considered. 

An additional decision factor concerns plans for uti 1 ization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsorj should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the CTR IRR 
manpower pool may be smaller than believed. Approximately 31 percent of the 
pool may not be contactable by mail. An additional segment of unknown size 
may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage of CTRs listed in IRR files could also be 
beyond the zone of involuntary recall. 

2 . CTR IRR personnel who work in ci v i 1 i an occupat i ons rel ated to 
their rating report less deterioration of skills than CTRs who are not 
similarly employed. This group should be considered for first recall 
priority. 

3. Retraining for all CTRs, regardless of civilian occupation, 
appears necessary to support mobilization. Formal refresher training prior 
to recall appears to offer the best solution to training needs. This 
conclusion is subject to concurrence by subject matter expert CTRs. 

4. Periodic maintenance training, after refresher training, would 
guard against future unwanted erosion of skills. 

5. CTR personnel off active duty for greater than 3 years wil 1 
probably require training on selected tasks to update skills. 

RECOMMENDATIONS 

1. Review, update, and validate the iRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
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from IRR members concerning civilian employment. At the very least nDUm 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall. 



3. Request resource sponsors review the data of this study 
Determine if agreement can be reached that the tasks generated by 
schoolhouse SMEs adequately represent the CTR-3 job. oetermine that the 
CTR-J job is, in fact, acceptable as the target performance level for 
training to support mobilization. Request resource sponsors to consider the 
data of this study against factors such as changes to materials, procedures 
equipment used by the rating, criticality of task performance, and 
mobilization plans for IRR personnel. Request resource sponsors determine 
the validity of data provided. 

4. Issue appropriate tasking, if the conclusions of this study are 
accepted, to develop a specialized premobilization curriculum for refreshing 
basic skills, and refreshing and updating operational skills. 

5. Task the NAVTECHTRACEN, Corry Station, to develop or assist 
development of a premobilization curriculum for CTR IRRs and a skill 
maintenance curriculum. 

no * 6 '- K Recal ! a sam P le of CTR IRRs to assess their knowledge of current 
CTR-3 job requirements. Use this information to validate the data and 
conclusions of this study. 
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CRYPTOLOGIC TECHNICIAN (TECHNICAL) (CTT): 

SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 

Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that tne 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN) , Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Cryptologic Techni- 
cian (Technical) (CTT) rating was one of thesp 16. 

PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit s mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. K 

APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used co obtain information. Six senior 
enlisted CUs, assigned to the Naval Technical Training Center, Corry 
Station, Pensacola, FL, served as subject matter experts (SME) for question- 
naire development. Under guidance given by the project staff, the CTT SMEs 
selected from various source materials a set of job tasks that, in their 
judgment best represented the job (non-NEC specific) of an active duty CTT- 
i. This level was chosen in the belief that a recalled ready reservist who 
could perform CTT job tasks competently at the E-4 level would make a posi- 
tive work contribution to a receiving unit. 



D-8-3 

ERIC 204 



Technic Report 86-007 



The CTT-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty CTT-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty CTT-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 10 December 1984, 657 CTTs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN). Questionnaires were mailed under 
CNO (0P-11) cover letter on 22 February 1985 to a random ssnple of 499 (76 
percent). Coordination with the Commander, Naval Security Group 
(COMNAVSECGRU) had previously been accomplished. Because of a low initial 
return rate, a follow-up mailing (342) was made on 8 April 1985. 
Questionnaire returns were accepted until 24 May 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT) , 
COMNAVSECGRU, and within CNO (0P-01) was accomplished for authorization to 
survey active duty CTT-3 personnel. A CTT-3 roster, current as of 2 August 
1985, was obtained from NAVMILPERSCOM. From a pool of 364, a sample of 271 
CTT-3s was determined using accepted survey research methods. 
Questionnaires were mailed on 18 September 1985 under CNO (0P-11) cover 
letter to unit/activity commanding officers for distribution to CTT-3s 
named. Returns were accepted until 31 December 1985. Returned 
questionnaires were scanned to determine data usability, and data were 
entered into computer files. Subsequently, summaries of the information of 
interest to the study were prepared. Unfortunately, questionnaires intended 
for CTT active duty personnel were inadvertently mailed to active duty 
Cryptologic Technicians (Collection) (CTR). Because of rating job 
similarities, much of the data were still usable and are appropriately 
reported. 

RESULTS 

Results pertinent to the assessment of CTT skill deterioration are 
presented in this section. 
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QUESTIONNAIRE RETURN STATISTICS 

Table D-8-1 shows, for both the IRR and active duty CTTs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid ret-jrns (nonvalid principally because 
of data base errors) is also shown. Percent usable returns was derived I by 
dividing the number returned (98) by the number delivered (i.e., 499 - ua 
361). 



Table D-8-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


499 


98 


27 


138 28 


Active Duty 


271 


158 


58 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-8-2 for IRR personnel and in tables D-8-3a and D-8-3b for active 
duty personnel. The tables are modified questionnaire forms. 

The data presented in table D-8-3a are from active duty CTR personnel. 
As mentioned, the CTT questionnaire was inadvertently mailed to CTRs. This 
table shows how the CTRs responded to CTT tasks. It is presented for 
information only. These data are not used in subsequent analyses to assess 
skill deterioration or training needs. 

The data given in table D-7-3b are from active duty CTTs. Data are 
available for only six tasks, however. These tasks were common to both CTTs 
and CTRs and were included on both questionnaires. 

Background Questions 

Of 94 IRR CTTs answering the question, 27 (approximately 29 percent) 
reported that they now work in a civilian occupation related to their Navy 
Cn rating. Answers to the remaining two background questions for IRRs (see 
table D-8-2) are not reported since it was determined that the answers would 
be somewhat redundant and could not be unambiguously interpreted. Of the 
active duty respondents answering the background questions (see table p-8- 
3b), 147 of 155 (94.8 percent) work in rating. One hundred thirty-eight 
(88!5 percent) are assigned shore duty. 



D-8-5 



206 



Technical Report 85-007 



Table D-8-2 

Overall Summary of CTT IRR Questionnaire Data 



PUT 1: 



AMStfU KEY: 



1. If necceeary, correct your Service 
■umber. 

2. Is the work Which you do KM related 
to your levy rating? 

Yea 27 lo 67 

3. Have you done PUVI0U8 «ork Which ia 
relet e4 to your Vavy rating 

fines your Expiration of Active 
Obligated service (lAOS)T 

Yea - lo - 

4. Have you received training related to 
your levy rating since your Expiration 
of active Obligated Service (lAOS)T 

tea - to - 



(1) Have never perforated the teak. 

(2) Can/could do simple parte of the teak 
(need direct supervision) . 

(3) Can/could do acst parte of the teak 
(need general supervision). 

(4) Can/could do all parte of the teak 
(need only occasional supervision. 
Meets minimum local apeed and accuracy 
standards. ) 

(5) Can/could do complete task quickly and 
accurately (need no supervision) • 



Pair 2: 

Por each job teak statement below: 

A. Indicate your CUEKEIT level of ability according to the answer key above. 

B. Estimate your PREVI0U8 level of ability at the tie* of your EAOS according to 
the answer ke _bove. 



"U>" Choices 
E * 

19 19.8 1 



Tasks 

Select antennae and transmission 
lines. 



9 9.5 2. Identify BP Interference. 

6 4. 3 3. Claaaify radio signal, modulation, 
and keying method; determine 
bandwidth. 

5 5.2 4. Perform external analysis of 

signals using publications and 
working aide. 

6 6.3 5. Proceee and eervlce mission- rale ted 

materials. 

4 4.2 a. account for t handle* stow, transmit 
and destroy classified material. 



A 

Mean 8D 



Mean 8D 



97 2.87 1.397 96 3.65 1.596 

95 3.28 1.456 95 4.02 1.337 
97 3.07 1.210 96 4.05 1.217 

97 3.43 1.282 96 4.38 1.117 

96 3.19 1.217 95 4.30 1.166 
96 3.72 1.303 96 4.50 1.026 
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Table D-8-2 (Continued) 



3 


3.1 


7. 


Prepcre magnetic recording! and ear* 
for ■agnatic tapes. 


97 


4.18 


1.216 


96 


4.73 


.814 


3 


3.1 


8. 


Identify non-Hone signals and ferae. 


97 


3.32 


1.263 


96 


4.32 


1.021 


30 


31.6 


9. 


Identify HIJI (Heaconing, 
Intrusion) signal* • 


97 


-.24 


1.297 


95 


2.87 


1.538 


25 


26.3 


10. 


Identify and claeeify BLOT and 
BLS8C eignale and terms. 


96 


2.47 


1.376 


95 


3.38 


1.683 


SO 


52.1 


11. 


Calculate maxima and minimum range 
and range resolution of radars. 


97 


1.90 


1*262 


96 


2.26 


1.517 


49 


51.6 


12. 


Identify radar fingerprinting 
applications* 


96 


1.90 


1*294 


95 


.2.43 


1.680 


SO 


53.2 


13. 


Read and uae 8BD8CAF. 


96 


1.85 


1.256 


94 


2.29 


1*556 


28 


30.1 


14. 


Perform tactical reporting. 


96 


2*44 


1.352 


93 


3*29 


1.704 


19 


19.8 


15. 


tecognise and roport CRITIC. 


95 


2.59 


1.317 


96 


3.59 


1.553 


12 


12.9 


16. 


Operate compu tar-based systems* 


93 


3.61 


1*344 


93 


3.77 


1.430 


4 


4.2 


i; . 


Operate receiving and peripherel 
equipment and perform operator 
functions t detect malfunctions* 


♦7 


3.38 


1.220 


96 


4.31 


1.108 


4 


4.2 


18. 


Interpret functions of the laVSIGGRU; 
interpret 81 security classification 
designations and categories* 


97 


3.23 


1.262 


96 


4.28 


1.073 


7 


7.4 


19. 


Use on-line and off-line analysis 
equipment and produce visual and 
graphic displays to aid in Identi- 
fications of sys»4m characteristics. 


95 


3*13 


1.265 


95 


4.20 


1.199 


36 


38.3 


20. 


Prepare for and perform fleet direct 
support operations. 


96 


2.24 


1.328 


94 


2.90 


1.704 


12 


12.8 


21. 


Prepare routine technicel reports. 


96 


3.23 


1.349 


94 


3.94 


1.435 


27 


28.1 


22. 


Identify classes of ships, elrcreft, 
and missiles* 


97 


2.35 


1.283 


96 


2.98 


1.569 


13 


13.8 


23. 


Identify cetegories of SICIHT alerts. 


94 


2.60 


1*221 


94 


3.45 


1.396 



24. I can/could type. 

25* I can/could copy Horse code. 



88 33wpm 15.765 91 36«pm 17.819 
72 70g/m 6.918 83 17g/m 11.388 



Overell Hean: 2.89 
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Table l)-8-3a 

Overall Summary of CTT Active Duty Questionnaire Data 



PART 1: 



AH SUKft KKY: 



1. If necessary, comet your Service 



2. Does your eurront billot roquiro you 
to work in you.* Bevy rating? 

Too Bo 8 

3. Vhftt typo duty is your eurront 
billot? 

8m 138 Short 18 



(1) Have novor performed tho took. 

(2) Con/could do simple ports of tho took 
(nood diroet ouporvioion) . 

(3) Con/could do moot porto of tho took 
(nood gonoral ouporvioion). 

(4) Con/could do oil porto of tho took 
(nood only occasional supervision. 
Moots minimum local spood and accuracy 
standards . ) 

(5) Can/could do complete task quickly and 
accurately (nood no supervision) • 



PatT 2: 

For each job task statement below: 

A. Use tho ansvsr key above to indicate your CURRENT level of ability. 

B. Use the answer key above to estimate your IIPBCTID level of ability after 2 
years of not performing these tasks. 



"(l) w Choices A B 

I % Tasks B Mean SD B Mean SD 

15 9.6 1. Select antennas and transmission 157 4.00 1.325 150 3.22 1.242 

lines. 

5 3.2 2. Identify RF interference. 155 4.33 .988 150 3.60 1.215 

10 6.5 3. Classify radio signal, modulation, 155 3.94 1.202 149 3.19 1.227 
and keying method; determine 
bandwidth. 

27 17.3 4. Perform external analysis of 156 3.53 1.439 150 2.86 1.253 
signals using publications and 
working aids. 

13 8.3 5. Process and service mission-related 156 3.89 1.258 148 3.05 1.222 
materials. 

6 3.8 6. Account for, handle, stow, transmit 157 4.23 1.067 151 3.57 1.219 

and destroy classified material. 
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Table D-8-3a (Continued) 



23 


14.6 


7. 


Pr#DAr* U striatic r*cordlnts Mid cam 

1 i V SStSS-^lWWa>W b VVWIU4II^V WWW 

for magnetic tepee. 


157 


4.03 


1.469 


149 


3.58 


1.419 


8 


5.2 


8. 


Identify non-Morso signals and ttcat. 


155 


4.03 


1.101 


148 


3 32 


1.229 


19 


12.3 


9. 


Identify MIJI (Heaconlng, 
Interference, J earning and 
Intrusion) signals. 


155 


3.52 


1.350 


148 


2.89 


1.196 


50 


32.1 


10. 


Identify and classify exist and 
IL31C signals and terns. 


156 


2. 72 


1.413 


145 


2.17 


1.149 


113 


72.0 


11. 


Calculata ■axiamai and mlniaua ranga 
and ranga rasolutlon of radars. 


157 


1.55 


.950 


145 


1.43 


1.434 


m 


84.0 


12. 


Idantlfy radar flngsrprintlng 
applications. 


156 


1.26 


.654 


145 


x , 28 


.684 


118 


77.1 


13. 


load and usa 8KD8CAF. 


153 


1.53 


1.089 


143 


1.48 


'.978 


54 


34.6 


14. 


Perform tactical raportlng. 


156 


2.81 


1.589 


149 


2.40 


1.288 


14 


9.0 


15. 


lacognisa and raport CRITIC. 


156 


3.71 


1.276 


150 


3.09 


1.300 


18 


11.7 


16. 


Opsrats computer-based systems. 


156 


3.74 


1.330 


147 


3.12 


1.255 


12 


7.8 


17. 


Oparata rs calving and parlpharal 
aqulpaant and parfom oparator 
functions; datact naif unctions. 


154 


4.01 


1.239 


146 


3.25 


1.202 


8 


5.1 


18. 


Intarprat functions of tha ■aVSEGCBU; 
intarprat 81 aacurlty clasalflcatlon 
dealgnatlons and categories. 


157 


4.03 


1.118 


150 


3.35 


1.182 




35 .9 




Usa on-line and off-line analysis 
aqulpaant and produca visual and 
graphic displays to aid in Identi- 
fications of systaa charactarlstlcs . 


156 


2. 72 


1.552 


147 


2.37 


1.315 


59 


37.6 


20. 


Prepare for and parfom flaat dlract 
support operations. 


157 


2.89 


1.662 


146 


2.56 


1.457 


40 


25.5 


21. 


Frapara routlna technical raporta. 


157 


3.19 


1.539 


148 


2.67 


1.306 


12 


7.6 


22. 


Idantlfy claaaaa of ships, aircraft, 
and missiles. 


157 


3.31 


1.165 


150 


2.67 


1.079 


8 


i 2 


23. 


Identify catagorlas of SICIaT alerts. 


155 


3.94 


1.091 


148 


3.22 


1.124 



24. I can/could typ«. 

23. I can/could copy Morse cods. 
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Table D-8-3b 

Overall Summary of Available CTT Active Duty Questionnaire Data 



PAR 1: 



A1SVI1 KR: 



If Mcunrjr, comet your Service 



2. Does your current billot require you 
to work in your levy rating? 

too J47 So • 

* ». 

3. Wot typo duty is your curront 
billotf 

Soa US. Shoro IS 



(1) novo novor porforood the task. 

(2) 



Con/could do simple parte of tho teak 
(nood diroct supervision) . 

Can/could do noat parte of the teak 
(nood general supervision) . 



(3) 



(4) Can/could do all parts of tho task 
(nood only occasional supervision, 
hoots minimum local speed and accuracy 
standards.) 

(5) Can/could do complete task quickly and 
accurately (nood no supervision). 



PAR 2: 

Por each job task statement below: 

A. Use the answer key above to indicate your CUftUR level of ability. 

B. Use tho answer key sbove to estimote your KXP1CTU) level of ability after 2 
years of not p e r f or mi ng those tasks. 



"(1)" Choices 
E * 



Tasks 

1. Select antennas and transmission 
linos. 



A 

Mean SO 



B 

Mean SO 



2. Identify IF interference. 

3. Clsssify rsdio signal, noduletion, 
and keying method; determine 
bandwidth. 

23 13.1 4. Perform external analysis of 
signals using publications and 
working olds. 

5. Process and service mission-related 
msterisls. 

5 2.1 A. Account for, handle* stow, transmit 
and destroy clsssified material. 



174 3.79 1.372 174 2.9* 1.155 



174 4 . 19 1 . 024 1 74 3 . 44 1 . 121 
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Table D-8-3b (Continued) 



7. Prepare magnetic recordings and car* 
for magnetic tapes. 

25 14.7 8. Identify non-Boree aignala and Unn. 174 3.37 1.359 173 2.48 1.1*5 

102 5t.O 9. Identify MIJI (Beaconing, 176 2.10 1.431 170 1.93 1.195 

Interference t Jaaadng and 
Intrusion) aignala. 

10. Identify and claaaify 1UIT and 
tLStC aignala and 



11. Calculate maximum and nininuai rente 
resolution of radar a. 



12. Identify radar fingerprinting 
applications. 

13. lead and van MMCaT. 

14. rerfom tactical reporting. 

40 22. a 15. tecotnize and resort dlTIC. 177 3.18 1.488 172 2.47 1.229 

21 12.0 14. Operate computer-based systeme. 175 3.94 1.383 171 3.28 1.223 

17. Operate receiving and peripheral 
equipment and perform operator 
functiona; detect naif unctions. 

18. Interpret functiona of the SAV8ICC8U; 
interpret 81 security classification 
designations and categoriea- 

19. use on-line and off-linn analysis 
eeuipnent and produce visual and 
graphic displays to aid in identi- 
fications of system characteristics. 

20. Prepare for and perforn fleet direct 
support operations. 

21. Prepare routine technical reports. 

22. Identify claaaea of ships, aircraft, 
and missiles. 

23. Identify categories of SICIST alerta. 

24. I can/could type. 

25. I can/could copy Morse code. 
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Task Performance Data 

The data summary tables (D-8-2 and D-8-3b) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks vi.e., they responded to the task description with a 
"1.") For IRRs, these data refer to the "at EAOS" answers and f^r active 
duty to the current (NOW) level of ability. 

Tables D-8-2 and D-8-3b also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SD) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR sample, table D-8-2, the "A" column 
reflects current average ability level; the "B" column, EAOS average ability 
level. For the active duty sample (table D-8-3b), the "A" column refers to 
current (NOW) ability and the "B" to proficiency expected after 2 years of 
rjonperformaoce of a task.l 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the CTT-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform most tasks of the 
rating at a level where general supervision would be needed (mean = 2.9). 

For the active duty group, means reflecting proficiency on each job 
task for CTTs working/not working in their rating were computed. These are 
shown in table D-8-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-8-5 displays task proficiency means for two subgroups of the 
CTT IRR respondents: (1) those who answered that they were now working 
("W") in a field related to the Navy CTT rating and (2) those who indicated 
that they were not working ("N") in a related field. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-8-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key. These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-8-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 
membership: current proficiency is less than EAOS proficiency. Values with 
no sigrs indicate increases in proficiency. 



1 These expected-after-2-years proficiency values were not used in sub- 
sequent analyses, however, since it was clear that many respondents did not 
understand the question being asked. 
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Table 0-8-4 

Available Task Mean Values for Two Subgroups of Active Duty CTTs 

Not Working ("N") 1 Working ("W") 2 

Task NOW EXP NOW EXP 

1 

2 
3 

4 4.077 3.154 4.217 3.248 
5 

6 4.267 3.800 4.286 3.730 
7 

8 4.154 3.000 3.715 2.970 

9 3.000 2.250 3.701 3.054 

10 ... 

11 - - 

12 - 

13 - 

14 - 

15 3.818 3.100 3.810 3.163 

16 4.308 3.643 4.371 3.518 



Composite Mean:* Group W NOW 

EXP 

Group N NOW 
EXP 

Overall Mean:* NOW 

EXP 



*These values were not computed for this rating. 

In = 16 
2 n = 159 
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Table D-8-5 

Task Mean Values for Two Subgroups of IRR CTTs 





Not Working ("N") 1 


Work i na 


(■■UM\2 


Mpan 

I IC Ul 1 


Di f f pppnrp 


Task 


NOW 

nun 




NOW 


EA0S 


"N" 


"W" 


1 


3.471 


4.357 


3.526 


4.167 


-0.886 


-0.641 


2 


3.649 


4.403 


3.903 


4.091 


-0.754 


-0.188 


3 


3.217 


4.344 


3.565 


4.043 


-1.127 


-0.478 


4 


3.433 


4.531 


4.160 


4.696 


-1.098 


-0.536 


5 


3.183 


4.651 


3.958 


4.174 


-1.468 


-0.216 


6 


3.850 


4.719 


4.458 


4.480 


-0.869 


-0.022 


7 


4.226 


4.848 


4.808 


4.917 


-0.622 


-0.109 


8 


3.295 


4.523 


4.167 


4.292 


-1.228 


-0.125 


9 


2.690 


3.783 


3.647 


3.765 


-1.093 


-0.118 


10 


2.930 


4.271 


3.650 


4.263 


-1.341 


-0.613 


11 


2.556 


3.742 


3.786 


3.231 


-1 186 


0 555 


12 


2.762 


3.963 


3.529 


3.882 


-1.201 


-0.353 


13 


2.565 


3.769 


3 600 


3 6fifi 


-1 704 


-0 Ofifi 


14 


3.047 


4.370 


3.813 


4.188 


-1.323 


-0.375 


15 


3.114 


4.241 


3.684 


4.250 


-1.127 


-0.566 


16 


3.679 


4.000 


4.654 


4.542 


-0.321 


0.112 


17 


3.361 


4.469 


4.192 


4.577 


-1.108 


-0.385 


18 


3.322 


4.484 


4.042 


4.360 


-1.162 


-0.318 


19 


3.167 


4.426 


4.120 


4.480 


-1.259 


-0.360 


20 


3.026 


4.122 


4.533 


4.214 


-1.096 


-0.681 


21 


3.421 


4.367 


4.136 


4.400 


-0.946 


-0.264 


22 


2.955 


3.851 


3.278 


3.650 


-0.896 


-0.372 


23 


2.900 


3.927 


3.333 


3.783 


-1.027 


-0.450 






Composite Mean: 


Group W 


NOW 3.893 







Group N 



Overall Mean: 



EOS 
NOW 
EOS 

NOW 
EOS 



4.180 
3.210 
4.268 



3.551 
4.224 



In - 
2n = 



67 
27 
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The table shows that CTTs who now work ("W") in a field related I . 
their former active duty jobs gained proficiency on 2 of 23 /"'ob tasks. Tms 
group also reported less skill deterioration over all other rating tasks 
than the "N" subgroup. Statistical tests (t tests for inde^ndent means; 
see Guilford and Fruchter, 1973) indicated tfiat over all tasks of the CTT 
rating, the proficienry of the two subgroups was equivalent at EAOS 
(t = -.8476, £< .2006). Task mean proficiency values differed significantly 
(t = 5.71, £< .00000045) on current (NOW) proficiency. 

TIME IN IRR 

Table D-8-6 provides a breakdown of CTT personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
IRRs off active duty more than 3 years. These mean values are shown for 
information only, since the number of individuals in each group is too small 
to permit meaningful quantitative interpretation. 



Table D-8-6 

Mean Proficiency Values for CTT IRR Respondents by Time Since EAOS 



Time (Mos.) 
Since EAOS 


Mean 


No. of Cases 


0-5 


3.23 


3 


6-11 






12-17 


3.46 


2 


13-23 






24-35 


2.83 


5 


35+ 


2.86 


71 


Overall Mean 


2.89 


81 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rate coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
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much useful information about the IRR that has not been available 
previously. They also suggest directions that should be ta<en with resprct 
to the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

Approximately 28 percent of questionnaires returned were classified as 
"nonvalid" (table D-8-1). They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from anotner 
service, was never on active duty in the Navy." (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 1985.) Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some, by relatives 
marked, "Deceased. M From the above data, it can be concluded that about 28 
percent of the CTT IRRs could not or would not be available for 
mobilization. 

Questionnaires were presumably delivered by the Postal Service to a 
number of CTTs (73 percent) from whom and about whom no information was 
received. It is likely that many did not respond for reasons such as those 
cited above—they felt the questionnaire was not applicable. A further 
group, of unknown size, then would also be unavailable for mobilization 
because they are not in the viable IRR manpower pool as is currently 
believed. These considerations prompt a recommendation for review and 
validation of the CTT IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that CTT respondents have been away from active duty. This information 
is given in table D-8-6. Almost 88 percent were in the IRR for more than 3 
years. Two issues emerge: (1) the need for skill upgrading and (2) 
availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group. CTT SMEs must make 
this determination, however, based on changes to how the job is now 
performed. 

A second consideration concerns the Military Service Obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. This should include an attempt to determine 
why so few CTTs were in the IRR group separated less than 3 years. 
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SKILL DETERIORATION 



ERIC 



Information directly pertinent to the question of skill deterioration 
was presented in table D-8-5. In table D-8-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 29 percent of CTT IRRs reported that they now work in a 
civilian occupation related to the CTT rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-8-5 
shows, CTTs who now work in a field related to their Navy rating gained 
proficiency on two job tasks. This "W" subgroup also reported less skill 
deterioration than the "N" subgroup for all other CTT job tasks. Taken over 
all tasks, differences between the current (NOW) proficiency means for the 
two subgroups were statistically significant. Also, they could not be 
attributed to initial differences between the groups at EAOS. Inus, 
civilian CTT-related employment significantly affected skill deterioration. 
Those continuing to work in the CTT field after EAOS reported less 
deterioration. The tasks on which the greatest amount of skill 
deterioration occurred are easily identifiable from table D-8-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to mobilization. Thus, the implications of 
skill deterioration data must be assessed against the criterion of 
acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by CTT IRRs against the 
levels reported by active duty CTT-3s. The task means for the active duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average CTT-3 now on active duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either tables D-8-2 or D-8-3a or b. The answer key shows that a 
value of "4," for example, represents skilled performance with only a ne?d 
for occasional supervision. Following conventional practice, we assume that 
a "4" is reflected by any values between 3.50 and 4.49. A "3" is 
interpreted similarly. Skill deterioration may be shown by lower mean 
values for NOW (i.e., current) versus EAOS proficiency. However, the change 
from EAOS scores may not be sufficient to move the IRR respondents to a 
lower proficiency category. For example, skill loss on tasks 1 to 10 
occurred for the IRRs working in a related field. However, the losses 
reported resulted in the IRRs remaining in the "4" category (see table D-8- 
5). We would conclude that the deterioration is of no consequence insofar 
as signaling a need for retraining. 

Assessment of the need for training IRR personnel to support 
mobilization should proceed with the application of similar logic. Table 

218 



Technical Report 86-007 



D-8-7 below presents the task mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the CTT rating 
and also for those who are. These values are from table D-8-5. Task 
proficiency means for active duty personnel working in their rating (taken 
from table D-8-4) are also shown in table D-8-7. Inspection of the data 
shows that 21 of the 23 joD tasks are essentially "4"s for IRR CTTs working 
in a related field. For IRR CTTs not working in a related field, 5 of the 
23 job tasks are "4"s. Hence, from these data alone, a fair conclusion is 
that training of CTR IRRs working in a related field would not be required 
before mobilization to bring proficiency to an acceptable level. On the 
other hand, training of CTT IRRs not working in a related field would be 
recommended before mobilization. 

■ » • 

Table D-8-7 

Task Mean Proficiency Values for IRR and Active Duty CTTs 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


1 


3.5 


3.5 




2 


3.6 


3.9 




3 


3.2* 


3.6 




4 


3.4* 


4.2 


4.2 


5 


3.2* 


4.0 




6 


3.9 


4.5 


4.3 


7 


4.2 


4.8 




8 


3.3* 


4.2 


3.7 


9 


2.7* 


3.6 


3.7 


10 


2.9* 


3.7 




11 


2.6* 


3.8 




12 


2.8* 


3.5 




13 


2.6* 


3.6 




14 


3.0* 


3.8 




15 


3.1* 


3.7 


3.8 


16 


3.7 


4.7 


4.4 


17 


3.4* 


4.2 




18 


3.3* 


4 0 




19 


3.2* 


4.1 




20 


3.0* 


3,5 




21 


3.4* 


4.1 




22 


3.0* 


3.3* 




23 


2.9* 


3.3* 




♦Probable training needs. 
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From our assessment, there seems to be no need for extensive retramui: 
or maintenance training of CTTs working in the field. In this case, 
average IRR CTT should be able to perform required job tasks at an 
appropriate level of competency with a modicum of refamiliarization. For 
the most part, this could probably be given by close, corrective supervision 
while the returnee is performing job tasks. 

The picture is different for CTT IRRs not working in the field. This 
average IRR CTT cannot be expected to be able to perform required job tasks 
at mobilization. Accordingly, retraining is indicated. Due to the nature 
of the CTT job, tasking should be issued to the appropriate CT community to 
develop a premobilization curriculum for formal training for this rating. 
Training emphasis should be on the tasks identified in table D-8-7. 

An additional factor to consider in assessing needs for training, 
however, concerns time since EAOS. Almost 88 percent of the CTT IRRs in the 
sample were away from active duty for more than 3 years (see table Q-8-6). 
Subject matter experts who review the data provided here may determine that 
skill upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 

VALIDATION OF DATA 

Our analyses indicate that to support mobilization there is a need for 
retraining CTT IRRs who are not currently working in civilian jobs related 
to the rating. For CTT IRRs now working in a rating-related job, it would 
appear that required proficiency (i.e., the level shown by current job 
incumbents) can for the most part be achieved by familiarization training 
under direct corrective supervision in quite short time periods for most job 
tasks. At worst case, instructional modules for training these prospective 
CTT returnees on given individual tasks may be required. There is an 
indication that retraining for most rating tasks, such as would be developed 
by a formal school setting (e.g., "A" School) is needed for retraining CTT 
IRRs not working in the field as civilians. Information not readily 
available to the project staff is needed, however, for firm decisions about 
the need for training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the i nf ormat i on provi ded by thi s report be 
evaluated/validated against a number of other considerations. Resource 
sponsors would be appropriate to validate training needs. 

Data Review 

As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much us:ful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
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of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the CTT 
rating. The NAVTRASYSCEN, if requested, could assist SMEs in this effort. 
Areas to be considered in the review/validation process are discussed next. 

Review Areas 

For our study, SMEs from the Naval Technical Training Center, Corry 
Station, Pensacola, FL, identified the job tasks they thought would be 
appropriate for returning IRR CTT members to perform. Other SMEs may not 
agree on the list* Resource sponsors should determine if these are indeed 
the job tasks that an IRR returnee (at mobilization) should be able to 
perform. Further, a companion decision is required concerning the 
acceptability of the reported level of competency. Since active duty 
personnel report that they, on the average, now perform at these levels, 
these data reflect E-4 criterion performance. Resource sponsors should 
consider whether less proficiency would be acceptable. If so, attendant 
training requirements for IRRs with concomittant resource requirements would 
be lessened. On judging the need for training, task critical ity, in terms 
of person i6l or equipment safety as it interacts with recent changes to 
mat rial, procedures, or equipment, must also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some esnecially chartered 
intermediate activity to provide needed training. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the CTT IRR 
manpower pool may be smaller than believed. Approximately 27 to 28 percent 
of the pool may not be contactable by mail. An additional segment of 
unknown size may have already reenlisted and/cr not be useful to the Navy 
for other reasons. A substantial percentage of CTTs listed in IRR files 
could also be beyond the zone of involuntary recall. 

2. CTT IRR personnel who work in civilian occupations related to 
their CTT rating reported less deterioration of skills than CTTs who are not 
similarly employed. 

3. Comprehensive retraining for CTTs who do not work in civilian 
occupations related to their CTT rating may be necessary prior to 
mobilization. Formal refresher training in an institutional setting should 
be considered. 
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4. CTT personnel off active duty for greater than 3 years will 
probably require training on selected tasks to update skills. 

5. Of the 23 CTT job tasks for which skill deterioration was 
assessed, indications are that several will require training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall . 

3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
schoolhouse SMEs adequately represent the CTT-3 job. Determine that the 
CTT-3 job is, in fact, acceptable as the target performance level for 
training to support mobilization. Request resource sponsors consider the 
data of this study against factors such as changes to materials, procedures, 
equipment used by the rating, critical ity of task performance, and 
mobilization plans for IRR personnel. 

4. Consider recalling a sample of CTT IRRs to assess their knowledge 
of current CTT-3 job requirements. Use this information to validate the 
data and conclusions of this study. 

5. Task the NAVTECHTRACEN, Corry Station, Pensacola, FL, to develop a 
premobilization curriculum for CTT IRRs. 
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INTRODUCTION 

Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve ( IRR ) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that tnc 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Electricians Mate 
(EM) rating was one of these 16. 

PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 

APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Two senior 
enlisted EMs, assigned to the Service School Command, Great Lakes, II, 
served as subject matter experts (SME) for questionnaire development. Under 
guidance given by the project staff, the EM SMEs selected from various 
source materials a set of job tasks that, in their judgment, best 
represented the job (non-NEC specific) of an active duty EM-3. This level 
was chosen in the belief that a recalled ready reservist who could perform 
EM job tasks competently at the E-4 level would make a positive work 
contribution to a receiving unit. 
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The EM-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel . Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty EM-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty EM-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of thess data 
collection instruments are shown in the next section. 

As of 25 September 1984, 1,190 EMs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Nanes and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN) . Questionnaires were mailed on 21 
November 1984 under CNO (OP-11) cover letter to a random sample of 500 (42 
percent). Because of a low initial return rate, a follow-up mailing (351) 
was made on 29 January 1985. Questionnaire returns were accepted until 28 
February 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), and 
within CNO (OP-01) was accomplish for authorization to survey active duty 
EM-3 personnel. An EM-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 4,692, a sample of 449 EM-3s was 
determined using accepted survey research methods. Questionnaires were 
mailed on 18 September 1985 under CNO (OP-11) cover letter to unit/activity 
commanding officers for distribution to EM-3s named. Returns were accepted 
until 31 December 1985. Returned questionnaires were scanned to determine 
data usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of EM skill deterioration are 
presented in this section. 

QUESTIONNAIRE RETURN STATISTICS ^ 

Table D-9-1 shows, for both the IRR and active duty EMs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percen* of nonvalid returns (nonvalid principally because 
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of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (198) by the number delivered (i.e., 500 - 35 = 
465). 



Table D-9-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


500 


198 


43 


35 7 


Active Duty 


449 


295 


66 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-9-2 for IRR personnel and in table D-9-3 for active duty personnel. 
The tables are modifie< questionnaire forms. 

Background Questions 

Of 189 IRR EMs answering the question, 104 (approximately 55 percent) 
reported that they now work in a civilian occupation related to their Navy 
EM rating. Answers to the remaining two background questions for IRRs (see 
table D-9-2) are not reported since it was determined that the answers might 
be redundant and could not be unambiguously interpreted. Of the active duty 
respondents answering the background questions (see table D-9-3), 274 of 294 
(93 percent) work in rating. Two hundred and fifty-nine (89 percent) are 
assigned shore duty. 

Task Performance Data 

The data summary tables (D-9-2 and D-9-3) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
"1.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of data (r = .944, p< .05) 
indicated significant agreement between the two classes of respondents. 
Thus, tasks which have not been performed by active duty EMs (to date) are 
the same tasks that had not been performed by IRRs at EAOS. 



Tables D-9-2 and D-9-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SD) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR sample, table D-9-2, the "A" column 
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Table D-9-2 

Overall Summary of EM IRR Questionnaire Data 



FAST 1: 



ARSUER KEY: 



1. If necetaery, comet Tour Service 
•r. 



3. 



It the work which you do WW related 
to your levy rating? 

Tee 104 lo g 

Have you done PREVIOUS work which it 
related to your iavy rating 
tlnce your Expiration of Active 
Obligated Service (BAOt)r 
Urn *> 



4. Have you received training roiatod to 
your Eavy rating a inco your Expiration 
of Active Obligated Service (EA08)t 
too Eo - 



(1) Have never performed tho taak. 

(2) Can/could do aimple porta of tho taak 
(noad diroct aupervition) . 

(3) Can/could do moat pacta of tha taak 
(nood general auparviaion). 

(4) Can/could do all parta of tha Uak 
(nood only occasional eupe v ft ion. 
Haota minimum local tpood and accuracy 
ttandardt.) 

(5) Can/could do complete taak quickly and 
accurately (nood no tuparvltlon) . 



PART 2: 

For oach Job taak etatement ho low: 

A. Indicato your G9REER lovol of ability according to tho anavor kay above. 

1. Eetlaate your previous lovol of ability at tho tint of your EA08 according to 
tho anavor bay above. 



w (ir Choicot 
t * 



Tatkt 



4 2.1 1. Uto and maintain technical 
and maintenance manuale* 

6 3.1 2. Toati eervice, and replace 
batter let* 

3 2.* 3. Repair or replace cablet and 
connectort. 

2* 13.* 4. Apply insulating material and 
varnithet. 

13 6.8 5. Sop lace worn gaakett and loalt 

of watertight electrical fixturee. 

6 3.2 •* Uto tluoprintt and drawingt to 
trace eirtuitt. 



I mean SD 1 Moan 80 

194 3.99 1.180 193 4.29 .966 

194 4.30 1.176 193 4.50 .958 

191 4.58 . 964 190 4 . 66 . 80S 

191 3.83 1.431 191 3 . 94 1 . 398 

192 4.39 1 . 248 192 4.52 1 . 102 
192 4 . 16 1 . 161 190 4 . 23 1.057 
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Table 0-9-2 (Continued) 



38 


19.7 


7. 


Operate, troubleshoot , and repair 


194 


2.91 


1.406 


193 


3.17 


1.401 








motion picture equipment . 














31 


14 5 
XV • ^ 


n 

Q • 




iW 


3 ai 


1 474 


1SS 
xoo 


<J » 33 


x . e«o 








supervisor duties. 


















t. 


Inspect end repair or replace: 














8 


4.2 




s. electrical safety equipment. 


192 


4.20 


1.268 


191 


4.43 


.997 




32.6 




b. electrostatic vent fof 


193 


2.93 


1.604 


190 


3.06 


1.640 








precipitator. 














69 


37.1 




c. cathode protective units. 


189 


2.52 


1.482 


186 


2.60 


1.501 






10. 


Troublesboot and repair: 














6 


3.1 




a. lighting circuits • power circuits 


194 


4.42 


1.099 


195 


4.59 


.900 








and portable tools. 














7 


3.6 




b. grounds, open circuits and short 


194 


4.34 


1.150 


192 


^4.45 


.991 








circuits in no tors and controllers. 














2ft 

XQ 


14 7 

x^ . # 










x • 3a a 


i an 
190 


* an 

J . oo 


x,. eau 






11. 


Perform preventive naintanance on: 














11 


5.7 




n. electrically powered ship 


194 


4.18 


1.340 


192 


4.43 


1.095 








eeuipnent. 














21 


11.1 




o. autoaatle emergency generator 


192 


3.53 


1.369 


190 


3.82 


1.310 








control systems. 














13 


6.8 




c. electrical distribution systeao. 


193 


3.87 


1.274 


190 


4.11 


1.186 


23 


12.0 




d. electrical components of air 


195 


3.51 


1.419 


191 


3.74 


1.366 








conditioning and refrigeration 




















control system and food service 




















eeuipnent. 














21 


11.1 




a. electrical conponents of dec* 


191 


3.67 


1.477 


189 


3.94 


1.103 








nachinery. 














9 


4.7 




f . electric motors and generators. 


192 


3.98 


1.288 


190 


4.25 

i 


1.103 






12. 


Ctand electrical watches at the 




















following stations: 














32 


16.8 




a. steering angineroom. 


190 


3.34 


1.588 


191 


3.91 


1.529 


31 


16.1 




b. anchor wind lass /hoist equipment 


190 


3.39 


1.541 


192 


3.85 


1.493 








and/or elevator. 














20 


10.5 




c. Ship's sarvlce/emsrgency 


188 


3.64 


1.490 


191 


4.24 


1.320 



distribution switchboard. 
13. what class ship(s) wars you on? 

Overall Mean: 3.78 
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Table D-9-3 

Overall Summary of EM Active Duty Questionnaire Data 



PAST 1: 



AM8WZR KEY: 



1. If MCMMry, corrtct your Sarvica 



2. Dooo your currant billot raqulro you 
to work in your lavy ratingt 

YH 274 lo 20 

3. What typo duty if your currant 
billott 

8aa thoro 251. 



(1) Hava novor porfomod tho took. 

(2) Con/could do olmplo porto of tha took 
(nood diroet suporvioion). 

(3) Con/could do aoot porto of tho took 
(nood gonorol suparvlslon). 

(4) Con/could do oil porto of tho took 
(nood only occasional ouporvlolon. 
tfoota minimal local opood arid accuracy 
atondardo.) 

(5) Can/could do comploto took quickly and 
accuratoly (nood no ouporvioion) . 



FAIT 2: 

for oach Job taak atatamont balow: 

A. Uoo tho onovor toy abovo to indict ta your CUEKttT lovol of ability. 

B. Uoo tho ansuor toy abovo to aotimato your UPtCTIO lovol of ability aftor 2 
yaaro of nat Performing thoao taato. 



M (1) M Choicoo 



A B 



£ % Taaka ■ Ha an 8D ■ Moan 8D 

10 3.4 1. Uoo and maintain tochnlcol 293 4.05 .995 281 3.69 1.079 
and malntonanco manuala. 

22 7.5 2. Toot, aorvico, and roplaco 294 4.35 1.161 280 4.18 1.129 
bat tor loo. 

9 3.1 3. Bopalr or roplaco cobloo and 293 3.60 1.538 278 3.44 1.420 
connactoro. 

60 20.5 4. Apply inauiatlnt motor ial and 293 3.60 1.538 278 3.44 1.420 
varniohoo • 

19 6.5 5. loplaca Morn gaakota and ooalo 294 4.50 1.086 282 4.36 1.028 
of watertight oloctrical fixturoo. 

13 4.4 6. Uoo bluaprinto and drawings to 294 3.98 1.049 283 3.59 1.127 
traco circuits. 

105 35.8 7. Oporato, troubloshoot , and repair 293 2.61 1.445 280 2.53 1.352 
motion plcturo oqulpmont. 
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10$ 


37.2 


8. 


?erfora electrical wort emtir 


290 


2.84 


1.470 


275 


2.56 


1.340 








supervisor duties. 
















9. 


Inspect and repair or rtplaet: 
















A ft 




m. electrical safety equipaant. 


293 


4.28 


1.093 


281 


3.91 


1.100 


§4 






b. electrostatic vent fog 


291 


2.97 


1.821 


279 


2.72 


1*466 








precipitator. 














1*5 


5* .9 




e. eatboda protective units. 


9 OA 


2.08 


1.429 


278 


2.12 


1.354 






10. 


Troublesboot and rapalr: 














$ 


2.7 




a. lighting circuits, power circuits 


29* 


4.35 


• 954 


282 


3.97 


1.067 








and portabla tools. 












13 


4.4 




b. i rounds » open circuits and abort 


294 


4.10 


1.070 


283 


3.63 


1.165 








circuits la actors and controllers. 














80 






c. snail boat alactrlcal systeaa. 


290 


3.27 


1.801 


278 


3.01 


1.463 






11. Perform preventive aalntsnance on: 














21 
*>* 


7.1 




a. electrlcslly powered ship 


293 


4.31 


1.153 


285 


3.68 


1.187 








squipsjsot. 














74 


25.3 




b. su tons tic oaargoncy generator 


293 


3.25 


1. 537 


'288 


2.94 


1.253 








control eyeteaa. 














2$ 


9.7 




e. alactrlcal distribution systeas. 


288 


3.77 


1.280 


280 


3.33 


1.253 


64 


22.0 




d. alactrlcal consonants of air 


291 


3.24 


1.453 


281 


2.90 


1.333 








conditioning and refrigeration 




















control systaaw and food service 




















equipaant. 














66 


22.6 




a. alactrlcal consonants of dock 


292 


2.37 


1.528 


278 


3.06 


1.367 








aacbinary. 














21 


7.1 




f . alactrlc actors and ganarators. 


294 


3.89 


1.175 


282 


3.44 


1.250 






12. Stand electrical watches at the 




















following stations: 














89 


30.4 




a. Starring anginsrooa. 


293 


3.39 


1.742 


279 


2.88 


1.499 


99 


33.7 




b. Anchor windlass/hoist squlpaant 


294 


3.18 


1.723 


278 


2.60 


1.470 








and/or elevator. 














40 


13.8 




c. Ship* s service /eaargency 


289 


3.93 


1.437 


278 


3.32 


1.347 








distribution switchboard. 













13. What class shlp(s) ware you ont 
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reflects current average ability level; the "B" column, EAOS average ability 
level. For the active duty sample (table D-9-3), the "A" column refers to 
current (NOW) ability and the "B" to proficiency expected after 2 years of 
nonperformance of a task.l. A Pearson Product Moment Correlation (r = .959, 
p < .05) computed between task means for IRR EAOS and active duty NOW 
(current proficiency) values indicated that the IRR members, while on active 
duty, performed job tasks at competency levels equivalent to those of 
current job incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the EM-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean = 3.8). 

For the active duty group, means reflecting proficiency on each job 
task for EMs working/not working in their rating were computed. These are 
shown in table D-9-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-9-5 displays task proficiency means for two subgroups of the EM 
IRR respondents: (1) those who answered that they were now working ("W") in 
a field related to the Navy EM rating and (2) those who indicated that they 
were not working ("N") in a related field. Both EAOS and NOW (current) 
proficiency means are given. These means, as well as those in table D-9-4, 
were computed from choices of 2, 3, 4, or 5 from the answer key. These 
choices place proficiency along a continuum from "Need direct supervision" 
through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-9-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR mem- 
bership: current proficiency is less than EAOS proficiency. Values with no 
signs indicate increases in proficiency. 

The table shows that EMs who now work ("W") in a field related to their 
former active duty jobs gained proficiency on 11 of the 23 job tasks. 
Although the differences are not large, this group also reported less skill 
deterioration than the "N" group for all but one of the other rating tasks. 
Statistical tests (t tests for independent means; see Guilford and Fruchter, 
1973) indicated thaf over all tasks of the EM rating the two subgroups were 
equivalent at EAOS (t = .4990, p_<.3101). Task mean proficiency values, 
however, differed significantly (t = 2.503, £ < .008) on current (NOW) 
proficiency. 



lThese expected-after-2-years proficiency values were net used in 
subsequent analyses, however, since it was clear that many respondents did 
not understand the question being asked. 
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Table D-9-4 

Task Mean Values for Two Subgroups of Active Duty EMs 

Not Working ("N") 1 Working ("W") 2 
Task NOW EXP NOW EXP 



1 


4.526 


3.722 




4.129 


3.776 


2 


4.750 


4.200 




4.608 


4.356 


3 


4.722 


4.313 




4.689 


4.453 


4 


4.600 


3.933 




4.243 


3.877 


5 


4.778 


4.278 




4.743 


4.500 


6 


4.176 


3.688 




4.068 


3.706 


7 


3.909 


3.600 




3.500 


3.233 


8 


3.545 


3.462 




3.629 


3.244 


9A 


4.471 


4.000 




4.444 


3.988 


9B 


4.222 


3.889 




3.904 


3.462 


9C 


3.750 


3.889 




3.500 


3.186 


10A 


4.611 


4.119 




4.431 


4.031 


10B 


4.353 


3.875 




4.247 


3.762 




H • X J J 






A 117 




UA 


4.824 


4.188 




4.539 


4.064 


UB 


4.083 


4.077 




4.000 


3.457 


11C 


3.867 


3.625 




4.086 


3.604 


11D 


4.071 


3.714 




3.854 


3.318 


HE 


4.286 


3.833 




4.042 


3.552 


11F 


4.059 


3.733 




4.117 


3.637 


12A 


4.357 


4.083 




4.439 


3.601 


12B 


4.467 


3.933 




4.244 


3.511 


12C 


4.063 


3.786 




4.431 


3.696 




Composite Mean: 


Group W 


NOW 


4.174 










EXP 


3.721 








Group N 


NOW 


4.288 










EXP 


3.932 






Overall Mean: 




NOW 


4.231 





EXP 3.827 



In = 20 
2n = 274 
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Table D-9-5 







Task Mean Values 


. jr Two Subgroups ol 


iRR LMs 






Not Working ("N") 1 


Working ("W") 2 


Mean 


Difference 


Task 


NUW 


CAftC 
tMUj 




UfwJ 


II M II 


II 1.1 M 
W 


1 


4.137 


4.402 


4.248 


4.277 


-0.265 


-0.029 


2 


4.453 


4.642 


4.626 


4.590 


-0.189 


0.036 


3 


4.513 


4.728 


4.890 


4.786 


-0.215 


0.104 


4 


4.046 


4.246 


4.473 


4.511 


-0.200 


-0.038 


5 


4.643 


4.769 


4.768 


4.760 


-0.126 


0.008 


6 


4.122 


4.222 


4.500 


4.381 


-0.100 


0.119 


7 


3.475 


3.662 


3.488 


3.682 


-0.187 


-0.194 


8 


3.879 


3.923 


4.138 


4.128 


-0.044 


0.010 


9A 


4.441 


4.577 


4.643 


4.566 


-0.136 


0.077 


9B 


3.833 


4.000 


3.986 


4.042 


-0.167 


-0.056 


9C 


3.314 


3.475 


3.493 


3.542 


-0.161 


-0.049 


10A 

X vn 


4.365 


4.634 


4.804 


4.743 


-0.269 


0.061 


10B 


4.192 


4.500 


4.749 


4.626 


-0.308 


0.123 


10C 


4.119 


4.288 


4.289 


4.374 


-0.169 


-0.085 


1 1A 

x in 


4.435 


4.649 


4.691 


4.612 


-0.214 


0.079 


UB 


3.642 


4.068 


4.054 


4.191 


-0.426 


-0.137 


11C 

X X\j 


3.957 


4.342 


4. 333 


A OQA 
4. CO 1 * 


-0.385 


0.049 


Ju XV 


3.873 


4.147 


4.021 


4.043 


-C.274 


-0.022 


HE 


4.065 


4.261 


4.253 


4.301 


-0.196 


-0.048 


11F 


3.957 


4.346 


4.500 


4.443 


-0.389 


0.057 


12A 


3.982 


4.422 


4.096 


4.506 


-0.440 


-0.410 


12B 


3.902 


4.41s 


4.094 


4.356 


-0.513 


-0.262 


12C 


4.095 


4.563 


4.314 


4.638 


-0.468 


-0.324 






Composite Mean: 


Group W 


NOW 4.324 












EOS 4.364 












Group N 


NOW 4.063 














EOS 4.317 










Overall Mean: 




NOW 4.193 







EOS 4.341 



In 

2 



n = 



85 
104 
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TIME IN IRK 

Table D-9-6 provides a breakdown of EM personnel by time spent in tne 
IRR prior tp mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
those IRRs who have been off active duty more than 3 years. Trends in skill 
deterioration over time are not apparent. 



Table D-9-6 

Mean Proficiency Values for EM IRR Respondents by Time Since EAOS 



Time (Mos.) 

Since EAOS Mean No. of Cases 

0-5 3.90 23 

6-11 3.72 24 

12-17 3.49 28 

18-23 3.99 23 

24-35 3.58 17 

36+ 3.91 41 

Overall Mean 3.78 156 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 
previously. They also suggest directions that should be ta!;en with respect 
to the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

Seven percent of questionnaires returned were classified as "nonvalid" 
(tab It D-9-1). They reflect probable errors in the IRR data base. The 
nonvalid category included, most prominently, questionnaires returned by the 
Postal Service as undel 'verable (bad addresses). It also included, but to a 
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much smaller extent, questionnaires returned by respondents with comments 
such as: M No longer in IRR, returned to active duty, already received final 
discharge. Retiree recruited from another service, was never on active duty 
in the Navy." (All information concerning such cases was transmitted to the 
Naval Reserve Personnel Center on 26 September 1985.) Finally, a very few 
questionnaires were returned by individuals who refused to provide 
information and, some, by relatives marked, "Deceased." From the above 
data, it can be concluded that about 7 percent of the EM IRRs could not or 
would not be available for mobilization. This number is not large compared 
to Other ratings studied and is probably acceptable to mobilization 
planners. However, there are other data base problems to consider. 

Questionnaires were presumably delivered by the Postal Service to a 
number Qf EMs (57 percent) from whom no information was received. It is 
likely that 'many did not respond for reasons such as those cited above— they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the EM 
IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that IRR EM respondents have been away from active duty. This 
information is given in table D-9-6. Twenty-six percent were in the IRR for 
more than 3 years. Two issues emerge: (1) the need for skill upgrading and 
(2) availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group despite their beliefs 
(table D-9-6) in their continuing ability to perform job tasks at a fairly 
high level. 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-9-5. In table D-9-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 55 percent of EM IRRs reported that they now work in a 
civilian occupation related to the EM rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-9-5 
shows, EMs who now work in a field related to their Navy rating gained 
proficiency on 11 job tasks. They also reported less skill deterioration 
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than the "N" subgroup on all but one of the other job tasks. Taken over all 
tasks, differences between the current (NOW) proficiency means for the two 
subgroups were statistically significant. Also, they could not be 
attributed to initial differences between the groups at EAOS. Thus, 
civilian EM-related employment significantly affected skill deterioration. 
Those continuing to work in the field after EAOS reported less 
deterioration. The tasks on which the greatest amount of skill 
deterioration occurred are easily identifiable from table D-9-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the 
implications of skill deterioration data must be assessed against the 
criterion of acceptable level of proficiency. This can be done most 
directly by comparing the cum. proficiency levels reported by EM IRRs 
against the levels reported by active duty EM-3s. The task means for the 
active duty sample can be taken as E-4 criterion performance since they 
reflect the level of proficiency claimed by the average EM-3 now on active 
duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either table D-9-2 or D-3-3. The answer key shows that a value of 
"4," for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
"4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean valuss for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
proficiency category. For example, skill loss on task IOC occurred for both 
subgroups of IRRs. However, the losses reported resulted in the IRRs 
remaining in the "4" category (see table D-9-5). We would conclude that the 
deterioration is of no consequence insofar as signaling a need for 
retraining. 

Assessment of the need fo- training IRR personnel to support 
mobilization should proceed with ti.e application of similar logic. Table 
D-9-7 below presents the task mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the EM rating and 
also for those who are working in a related field. These values are from 
table D-9-5. Task proficiency means for active duty personnel working in 
their rating (taken from table D-9-4) are also shown in table D-9-7. 
Inspection of the data shows that all values, with the exception of task 9c 
for the IRR not working in field subgroup, are essentially "4"s. Hence, 
from these data alone, a fair conclusion is that training of EM IRRs would 
not be required before mobilization to bring proficiency to an acceptable 
level. The only possible exception is task 9c. 
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From our assessment, there seems to be no need for extensive retraining 
or maintenance training prior to a mobilization recall. The average IRR EM 
should be able to perform required job tasks at an appropriate level of 
competency with a modicum of refamiliarization at mobilization. For the 
most part, this could probably be given by close, corrective supervision 
while the returnee is performing job tasks. This conclusion pertains to all 
EMs but is probably especially relevant to the 55 percent of IRR EMs who 
continue to work in an EM-related occupation. 



Table D-9-7 

Task Mean Proficiency Values for IRR and Active Duty EMs 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


1 


4.1 


4.3 


4.1 


2 


4.5 


4.6 


4.6 


3 


4.5 


4.9 


4.7 


4 


4.0 


4.5 


4.2 


5 


4.6 


4.8 


4.7 


6 


4.1 


4.5 


4.1 


7 


3.5 


3.5 


3.5 


8 


3.9 


4.1 


3.6 


9a 


4.4 


4.6 


4.4 


9b 


3.8 


4.0 


3.9 


9c 


3.3* 


3.5 


3.5 


10a 


4.4 


4.8 


4.4 


10b 


4.2 


4.7 


4.2 


10c 


4.1 


4.3 


4.1 


11a 


4.4 


4.7 


4.5 


lib 


3.6 


4.1 


4.0 


11c 


4.0 


4.3 


4.1 


lid 


3.9 


4.0 


3.9 


lie 


4.1 


4.3 


4.0 


llf 


4.0 


4.5 


4.1 


12a 


4.0 


4.1 


4.4 


12b 


3.9 


4.1 


4.2 


12c 


4.1 


4.3 


4.4 


♦Probable training needs. 







An additional factor to consider in assessing needs for training, 
however, concerns time since EA0S. Twenty-six percent of the EM IRRs were 
away from active duty for more than 3 years (see table D-9-6). Subject 
matter experts who review the data provided here may determine that skill 
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upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 

VALIDATION OF DATA 

Our analyses indicate that the need for training of EM IRRs to support 
mobilization requirements is not great. It would appear that required 
proficiency {i.e., the level shown by current job incumbents) can for the 
most part be achieved by familiarization training under direct corrective 
supervision in quite short time periods for most job tasks. There are no 
indications that comprehensive retraining for all rating tasks, such as 
would be provided in a formal school setting (e.g., "A" School), is needed. 
At worst case, instructional modules for training prospective EM returnees 
on given individual tasks may be required. Infonr.>cion not readily 
available to the project staff is needed, however, for firm decisions about 
the need for training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the information provided by this report be 
evaluated/validated against a numoer of other considerations. Resource 
sponsors would be appropriate to validate training needs. 

Data Review 

As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the EM rating. 
The NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to 
be considered in the review/validation process are discussed next. 

Review Areas 

For otr study, SMEs from the Service School Command, Great Lakes, II, 
identified tfce job tasks they thought would be appropriate for returning IRR 
EM members to perform, other SMEs may not agree on the list. Resource 
sponsors should determine if these are indeed the job tasks that an IRR 
returnee (at mobilization) should be able to perform. Further, a companion 
decision is required concerning the acceptability of the reported level of 
competency. Since active duty personnel report that they, on the average, 
now perform at these levels, these data reflect E-4 criterion performance. 
Resource sponsors should consider whether less proficiency would be 
acceptable. If so, attendant training requirements for IRRs with 
concomittant resource requlreim ^s would be lessened. On judging the need 
for training, task criticallty, in terms of personnel or equipment safety as 
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it interacts with recent changes to material, procedures, or equipment, must 
also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Further, while decisions must still be made concerning formal 
training, either institutional or via OJT, our belief is that this type of 
training can be limited. 

Finally, based on (1) the IRR members 1 reports of their current 
relatively high residual levels of proficiency and (2) literature findings 
that maximum skill loss occurs after about 1 year of nonuse of skills, it 
appears that skill maintenance training for EMs is not strictly necessary. 
Again, however, this conclusion must be weighed against planned utilization 
of recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the EM IRR 
manpower pool may be smaller than believed. Approximately 7 percent of the 
pool may not be contactable by mail. An additional segment of unknown size 
may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage (26 percent) of EMs listed in IRR files 
could also be beyond the zone of involuntary recall. 

2. EM IRR personnel who work in civilian occupations related to their 
rating reported less deterioration of skills than EMs who are not similarly 
employed. 

3. Comprehensive retraining and maintenance training for IRR EMs 
appear to be unnecessary to support mobilization. Familiarization training, 
at recall, consisting of supervised practice may suffice. This conclusion 
is subject to concurrence by subject matter expert EMs. 

4. EM personnel off active duty for greater than 3 years may require 
training on selected tasks to update skills despite their reported 
continuing high proficiency levels. 

5. Of the 23 EM job tasks for which skill deterioration was assessed, 
indications are that none will require any concerted training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 
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6. For all EM IRRs, mean values of current proficiency reported 
compare favorably with those reported by active duty personnel. This 
finding also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recal 1 . 



3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
school house SMEs adequately represent the EM-3 job. Determine that the EM-3 
job is, in fact, acceptable as the target performance level for training to 
support mobilization. Request resource sponsors consider the data of this 
study against factors such as changes to materials, procedures, equipment 
used by the rating, critical ity of task performance, and mobilization plans 
for IRR personnel. 

4. Consider recalling a sample of EM IRRs to assess their knowledge 
of current EM-3 job requirements. Use this information to validate the data 
and conclusions of this study. 
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APPENDIX D 



ANNEX 10 



EQUIPMENT OPERATOR (EO): 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by 0P-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Equipment Operator 
(E0) rating was one of these 16. 



PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance 
proficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 



APPROACH 



Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Five senior 
enlisted EOs, assigned to the Naval Construction Center, Gulf port, MS, 
served as subject matter experts (SME) for questionnaire development. Under 
guidance given by the project staff, the E0 SMEs selected from various 
source materials a set of job tasks that, in their judgment, best 
represented the job (non-NEC specific) of an active duty E0-3. This level 
was chosen in the belief that a recalled ready reservist who could perform 
job tasks competently u the E-4 level would make a positive work 
contribution to a receiving unit. 
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The EO-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about 
proficiency on each job task at the End of Active Obligated Service (EAOS) 
and at the present time (NOW). The difference between proficiency at EAOS 
and current proficiency would reflect skill deterioration during IRR 
membership. 

Questionnaires mailed to active duty E0-3s requested information about 
current ' proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty EO-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 25 September 1984, 459 EOs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN). Questionnaires were mailed on 31 
October 1984 under CNO (OP-li) cover letter to a random sample of 370 (81 
percent). Because of a low initial return rate, a follow-up mailing (256) 
was made on 29 January 1985. Questionnaire returns were accepted until 28 
February 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CIN r lANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), and 
within CNO (0P-01) was accomplished for authorization to survey active duty 
EO-3 personnel. An EO-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 443, a sample of 271 E0-3s was 
determined using accepted survey research methods. Questionnaires were 
mailed on 18 September 1985 under CNO (0P-11) cover letter to unit/activity 
commanding officers for distribution to E0-3s named. Returns were accepted 
until 31 December 1985. Returned questionnaires were scanned to determine 
data usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of E0 skill deterioration are 
presented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table D-10-1 shows, for both the IRR and active duty EOs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid returns (nonvalid principally because 
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of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (147) by the number delivered (i.e., 370 - 43 = 
327). 



Table D-10-1 



Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


370 


147 


45 


43 12 


Active Duty 


271 


143 


53 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-10-2 for IRR personnel and in table D-10-3 for active duty 
personnel. The tables are modified questionnaire forms. 

Background Questions 

Of 144 IRR EOs answering the question, 89 (approximately 62 percent) 
reported that they now work in a civilian occupation related to their Navy 
E0 rating. Answers to the remaining two background questions for IRRs (see 
table D-10-2) are not reported since it was determined that the answers 
would be somewhat redundant and could not be unambiguously interpreted. Of 
the active duty respondents answering the background questions (see table D- 
10-3), 120 of 140 (86 percent) work in rating. Ninety-two (66 percent) are 
assigned shore duty. 

Task Performance Data 

The data summary tables (D-10-2 and D-10-3) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
M 1. M ) For IRRs, these data refer to the "at EA0S" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of data (r = .943, p< .05) 
i nd i cated sign i f i cant agreement between the two cl asses of respondents . 
Thus, tasks which have not been performed by active duty EOs (to date) are 
the same tasks that had not been performed by IRRs at EA0S. 
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Table 0*10-2 
Overall Summary of EO IRR Questionnaire Data 



PAST 1: 



AMSWER KEY: 



1. If necessary, comet your Service 
■writer. 

2. Is ths work Which you do VOW related 
to your levy rat loft 

tee J2L _55_ 

3. Have you done PUVIOU8 work Which Is 
related to your levy rating 

since your Expiration of Active 
Obligated Service (BADS)T 

Yes - *o - 

4. Have you received training related to 
your levy rating since your txplratlon 
of Active Obligated Service (tAOS)T 

*as Mo - 



CI) Have never performed the task. 

(2) Can/could do simple parts of the task 
(need direct supervision). 

(3) Can/could do most parts of the task 
(need general supervision). 

(4) Can/could do all parts of the task 
(need only occasional supervision. 
Meets minimum local speed and accuracy 
standards • ) 

(5) Can/could do complete task quickly and 
accurately (need no supervision)* 



P/ABT 2: 



For each job task statement below: 

A. Indicate your CURREST level of ability according to the answer key above. 

B. Estimate your PREVIOUS level of ability at the time of your BAOS according to 
the answer key above. 



"(1) M Choices A B 

£ % Tasks H Keen SD I Mean SD 

25 17.9 1. Interpret grade stake Markings. 146 3.16 1.318 140 3.04 1.391 

31 22.3 2. Change attachments and adapt cable/ 146 3.44 1.429 139 3.11 1.468 
hydraulic assemblies on tractors 
(Wheeled and crawler) with front 
and rear Mounted and towed attachment. 

51 37.0 3. Check grade with hand level and 145 2.83 1.607 138 2.62 1.525 

leveling rod and transfer elevations 
using a rod and engineer's level. 

11 8.0 4. Perf on operator Inspections, 145 4.30 .967 138 4.01 1.232 

services and maintenance on 
automotive » construction material 
and support equipment. 

16 11.4 5. Hount, dismount and maintain tires. 146 4.15 1.331 140 3.96 1.403 
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Table D-10-2 (Continued) 



32 22.9 6. us* and maintain wire ropes usa 
slings, spreadara, pellets, cargo 
nata and hooka. 

31 22.0 ?. Prapara time cards and standard 
materiel requisitions. 

22 16.1 8. Maintain dlspatchar records and 
logs. 

9. Operate, perform oparator 
maintenance and praaUrt checks, 
change attachments sad adapt 
cable/hydraulic assemblies on: 

52 37.4 *. Crawler crana. 

51 37.5 b. Truck or Wheel mounted crana. 
46 34.1 c. Multi-purpose excavator. 

10. Operate/perform oparator 
maintenance, praaUrt chacks/ 
adjustments on: 

27 19.4 «. Ai r compressor. 

65 47.8 b. Crawlar Mounted rock drill. 

70 50.7 c. Portable rotary rock drill. 

52 d\ Power earth auger. 

'4 54.0 «. piio drivers (dlesel and 

pneumatic) . 

11. Operate and perfoni operator 
maintenance and preetart checks on: 

Motorized and wheal tractor drawn 
acraper. 
Motor grader. 

Asphalt paver and distributor 
Self-propelled soil 
stabilisation mixer. 
Bough terrain forkllft. 
Transit mixer. 
Self-propelled compaction 
Tractors (wheeled and crawler) 
with front and rear Mounted and 
towed attachments. 
Front end loaders (wheeled and 
crawler). 

Warehouse and rrugh terrain 
forkllf ta up to and including 
6000 pounda capacity. 
15 10 • * k. Vehicles through 5-ton including 

truck-tracktor 5-ton with semi- 
trailer. 



37 


26.6 


a. 


21 


14.9 


b. 


46 


48.2 


c. 


•3 


47.0 


d. 


18 


12.9 


a. 


52 


38.0 


f. 


29 


20.9 


g. 


20 


14.7 


h. 


16 


11.8 


1. 


16 


11.9 


J. 



147 


3.50 


1.528 


140 


3.27 


1.540 


147 


3.57 


1.419 


141 


3.24 


1.526 


144 


3.83 


1.376 


137 


3.66 


1.487 


146 


2.81 


1.599 


139 


2.63 


1.524 


143 


2.90 


1.607 


136 


H.63 


1.529 


143 


2.92 


1.599 


135 


2.69 


1.513 


143 


3.83 


1.458 


139 


3.45 


1.557 


143 


2.65 


1.667 


136 


2.40 


1.589 


145 


2.50 


1.625 


138 


2.29 


1.539 


145 


2.80 


1.636 


136 


2.63 


1.587 


143 


2.36 


1.381 


137 


2.18 


1.501 


145 


3.52 


1.573 


139 


3.20 


1.58C 


147 


3.78 


1.417 


141 


3.51 


1.471 


1iA 


2 .a* 


1.303 


137 


2.22 


1.439 


142 


2.48 


1.556 


134 


2.32 


1.520 


145 


4.06 


1.311 


140 


3.89 


1.433 


143 


3.00 


1.649 


137 


8.76 


1.629 


145 


3.73 


1.538 


139 


3.48 


1.576 


143 


4.01 


1.379 


136 


3.79 


1.425 


143 


4.34 


1.150 


136 


4.07 


1.356 


142 


4.29 


1.194 


135 


4.01 


1.401 


147 


4.49 


1.029 


140 


4.19 


1.324 



Overall Km: 3.40 
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Table D-10-3 

Overall Summary of EO Active Duty Questionnaire Data 



FAIT 1: 



AISWER KR: 



1. If nacassary, comet jour Sarvica 
Mbir, 

2. Doss your currant blllat raquira you 
to work in your lavy ratine f 

faa 120 Wo . 

3. What typo duty it your curr. 
b(llatf 

) • < . t; Soa Ihora 92 



(1) Hava novor parfomad tho task. 

(2) Can/could do s lapis parta of tho taak 
(naad dlract auparviaion). 

(3) Can/could do s»st parta of tha taak 
(naad sanaral supsrvlslon) . 

(4) can/could do all parta of tha taak 
(naad only occasional auparviaion. 
Haata ainiaua local apaad and accuracy 
standards. ) 

(5) Can/could do coaplsta taak quickly and 
aecurataly (naad no auparviaion) . 



PAST i: 

for aach job taak stataaant balov: 

a. Uaa 'a* answsr kay abova to lndlcata your CURED! laval of ability. 

B. Uaa tha answsr kay abova to sit lasts your HFICTtD laval of ability aftar 2 
yaara of Qftfc parfomlng thaaa taaka 



"(1)" Cholcaa 

I * 

15 10.5 
17 11. a 

42 29.4 



Taaka 

1. Intarprat srada ataka markings. 

2. Changs attachnanta and adapt eabla/ 
hydraulic aaaaafella* zu tractors 
(Whaalad and eravlar) with front 
and raax nountad and towad attachaant. 

3. Chack grada with hand laval and 
lavaling rod anu tranafar alavatlona 
using a rod and snginaar'a laval. 

4 2.8 4. Farfom oparator inapaetlona, 
sarvicas and naintanancs on 
sutoaotiva, construction natarial 
and r tort aoulpnaat. 

10 7.0 5. Mount t dlasjount and Maintain tlraa. 

19 13.3 I. Uaa and maintain wira ropa; uaa 
s lints, spraadara* pallata 9 cargo 
oats and hooka. 



A 

a Hsan 
143 



8D 



B 

Mssn 



8D 



143 



3.44 1.179 139 
3.7* 1.308 139 



2.88 1.145 
3.33 1.337 



143 2.54 1.299 139 2.31 1.215 



143 4.5* .91* 140 4.2* 1.050 



143 4.41 1.096 138 
143 3.*5 1.354 139 



4.15 1.220 
3.3* 1.3*7 
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Table 0-10-3 (Continued) 



24 


16.8 


7, 


Prapara tlma earda and standard 


143 


3.25 


1.375 


138 


2.73 


1.207 








matarlal raqulsltlons. 














9 


6.3 


8. 


Maintain dltpatehar racorda and 


142 


4 06 


1 186 


139 


3.52 


1.242 








logs. 


















9. 


Oporata, parforn opar&twf 




















malntananca and peas tart cbacka. 




















change attachments and adapt 




















*>V1 A/tMMtMi|1 \m aaaaaaklfaa nn ■ 
cioitf iywwi*6 •vmbvaiw vti. 














56 


39.4 




• • tTwiir crana. 


ii) 
14£ 


9 A9 

Z.4Z 


i. a ia 


199 


9 ii 
2.40 


1 .921 


47 


33.6 




■P. iMKK VI WOTV1 ■MnUtt WIWW . 




2 aa 


l aaa 


1IC 


9 AA 


1 9T« 

1.9 79 


50 


35.5 






141 


> 71 

A* f A 


1 5M 


1IC 




i aaa 

A* •»•»• 
















































■^IllflkaMtl Aft* 
Mil 










r 




1 A 
1U 


i 0 




• « air cnprHfQr < 


1 At 

laj 


A At 

a. v9 


1. Z44 


1 99 

190 


1 <A 

3.60 


1 9C* 

1.299 




A7 A 




d. crazier wounyao roc* orm. 


1 A% 

143 


* Ad. 

2.46 


1.902 


i it 
135 


2.40 


r. 482 


AA 


• & « J 




c rorMvit rosary roca arm. 


ia9 


1 AT 

1.97 


1 til 

1. 399 


192 


1 AC 

2.05 


i i ii 

1.398 


99 


JO. 9 




d. Power aarth auger. 


1 A% 

143 


* K 1 

2.57 


1.456 


136 


2.57 


1.375 


©0 


99.9 




e. Plla drivers idleeel and 


143 


2.05 


1.334 


135 


2.12 


1.322 








. a \ 

pneumatic) • 


















11. 


Oparata and perform oparator 




















maintenance and prat tart checks on: 














91 


99 • 7 




a. no cornea ana wnaai tractor orewn 


1 At 

149 


9 a a 
2. 94 


1.662 


1 1* 
136 


i ii 
2. 74 


lit 

1.407 








■erapar • 














$ 


4.2 




b. Matar trader. 


143 


a so 


1 A 7«. 


1 to 


9 OA 


i. 19a 


55 


38.5 




c. aaphalt paver and distributor 


143 


2.59 


1.474 


135 


2.42 


1.411 


90 


62.9 




d telf-propelled aoll 


143 


1.83 


1.263 


134 


1.92 


1.327 








stabilisation mlxar. 














8 


5.6 




a. lough ta train f oral 1ft. 


143 


4.51 


1.093 


139 




1.041 


61 


42.7 




f. Tranalt mlxar. 


143 


2.76 


1.683 


134 


2.67 


1.545 


15 


10.6 




g. Self-propelled compact ion 


142 


3.98 


1.329 


139 


3.74 


1.332 


1 


.7 




h. Tractors (Wheeled and crawler ) 


142 


4.41 


.576 


137 


3.96 


1.187 








with front and rear mountad and 




















towed attaebmanta. 














6 


4.3 




1. Front and loaders (Whaalad and 


140 


4.59 


.936 


135 


4.31 


1.054 








crawler) . 














1 


,7 




j. Warehouee and rough tarrain 


143 


4.69 


.743 


13. 


4.39 


1.021 








fort lift* up to and including 




















6000 pounda capacity. 














1 


.7 




h. Vahiclaa through 5-ton inducing 


143 


4.80 


.612 


138 


4.49 


.968 



truefc-tcwefctor 5-ton with ■•al- 
tratlar. 
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Tables D-10-2 and D-10-3 also show, for each task listed on a 
questionnaire, mean values for performance proficiency/competency, the 
standard deviation (SD) around the mean, and the number of cases (n) on 
which a mean is based. For the IRR 'ample, table D-10-2, the "A" column 

tS r CUrT Jt nt av 5 age L» b111ty the MB " column - EAOs average ability 

level. For the active duty sample table D-10-3), the "A" column refers to 
current (NOW) ability and the "B" to prof iciency expecteS after 2 years of 
nonperformance of a task.l A Ptarson Product Moment Correlation (r = .970 
p <.05) computed between task means for IRR EAOS and active ^uty NOW 

dui?7 l£^ en ?{ ] V . al i eS " :ndicates that the IRR members, while on active 
duty, performed job tasks at competency levels equivalent to those of 
current job incumbents. 



For the, IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 

tte^r?l Vlf too j l b W entirety (as reflected by the tasks used) 
I* 9 ! I °« *, RR uTfV f ? els that he could now P erf °™ tasks of the 
(mean - 3.4). With ° vera11 need for general supervision 

For the active duty group, means reflecting proficiency on each iob 
?n Shif^!!! 9 ^ 01 / 0 ^ 1 " 9 in their rating were computed. These are 
fSrXn^ D 0 -nl°;. 4 - A9ain ' the ex P"ted-after-2-years data are provided 

SKILL DETERIORATION 

cn TD I able D "3 0 ". 5 dis P\ ays task Proficiency means for two subgroups of the 
E0 IRR respondents: (1) those who answered that they were now work inaCw"! 
in a field related to the Navy E0 rating and (2) those ^ whTi Sated that 
they were not working ("N") in a related field. Both EAOS and NOW (current) 
proficiency means are given. These means, as well as those in table D-10-4 
?h^oc 0mP S ,ted f ™ choices ° f 2 . 3, 4, or 5 from the answer key. These 
I „ p J ac f P roflcl e n cy along a continuum from "Need direct supervision" 
through "Need no supervision." supervision 

^ * As ™ ioned earlier . skill deterioration is reflected by differences 
£221. ^ pro . ficiency and NOW proficiency. In table D-10-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 

^nn^f^^T 6 ^ P roficienc * is less than EAOS prof iciency. * Values *w th 
no signs indicate increases in proficiency. 

J he * able shows that EOs who now work ("W") in a field related to their 
former active duty jobs gained proficiency on all 30 job tasks. The "N" 
group lost proficiency on 19 of the 27 tasks. Statistical tests (t tests 

at Itm ft - n 9 ^\ h i%f° flC i en P y 0f the tiro subgroups was equivalent 

Mfeltll V, 1, P-5* 3113 ^ Task ">ean proficiency values, however 
differed significantly (t = 3.6575, p<0Q03) for current (NOW) proficiency 

iThese expected-after-2-years proficiency values were not used in 
subsequent analyses, however, since it was clear that many respondents d 3 
not understand the question being asked. qiq 
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Table 0-10-4 

Task Mean Values for Two Subgroups of Active Duty EOs 



h = 20 
2 n = 120 





Not Working ("N") 1 




Working ("W") 2 


Tack 


NOW 


EXP 




NOW 


EXP 


i 


3.786 


3.133 




3.703 


3.037 


2 


3.571 


2 133 




4.202 


3.731 


3 


3.500 


3.333 




3.122 


2.821 


4 


4.263 


3.882 




4.735 


4.448 


5 


4.813 


4.667 




4.649 


4.355 


6 


4.000 


3 • 833 




4.045 


3.689 


7 


3.667 


3.063 




3.673 


3.095 


8 


4.278 


3.579 




4.259 


3.757 


9A 


3.000 


3.000 




3.342 


3.152 


9B 


2.889 


2.846 




3.506 


3.293 


SC 


3.333 


3.182 




3.646 


3.387 


10A 


4.000 


3.471 




4.272 


3.824 


10B 


3.857 


3.500 




3.761 


3.368 


IOC 


3.600 


3.250 




3.469 


3.189 


10D 


3.500 


3.333 




3.563 


3.256 


10E 


3.000 


3.000 




3.389 


3.158 


UA 


3.700 


3.200 




4.050 


3.587 


UB 


4.333 


3.789 




4.448 


4.018 


11C 


3.375 


3.500 




3.628 


3.222 


110 


3.800 


3.750 




3.130 


3.182 


he 


4.722 


4.222 




4 713 




11F 


4.500 


3.923 




3.971 


3.580 




4.231 


3.923 




4.333 


4.046 


11H 


4.333 


3.705 




4.530 


4.135 


111 


4.400 


3.895 




4.811 


4.519 


11J 


4.350 


4.053 




4.773 


4.522 


UK 


4.500 


4.053 




4.874 


4.646 




Composite Mean: 


Group W 


NOW 


4.022 










EXP 


3.686 








Group N 


NOW 


3.900 










EXP 


3.564 






Overall Mean: 




NOW 


3.961 





EXP 3.625 
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Table D-10-5 



Task Mean Values for Two Subgroups of IRR EOs 



Task 

1 
2 
3 
4 
5 
6 
7< 
8 
9A 
9B 
9C 
10A 
10B 
IOC 
10D 
10E 
11A 
11B 
11C 
11D 
HE 
11F 
11G 
11H 
111 
11J 
UK 



Not Working ("N") 


NUW 


EAOS 


3.289 


3.512 


3.511 


3.600 


3.353 


3.517 


4.245 


4.340 


4.265 


4.370 


3:868 


3.789 


3.886 


3.974 


4.085 


4.227 


3.483 


3.385 


3.552 


3.462 


3.414 


3.296 


4.091 


4.100 


3.731 


3.391 


3.870 


3.500 


3.724 


3.625 


3.409 


3.500 


3.919 


4.088 


3.854 


4.136 


3.500 


3.500 


3.231 


3.348 


4.200 


4.438 


3.500 


3.714 


4.000 


4.125 


4.082 


4.304 


4.185 


4.396 


4.340 


4.500 


4.453 


4.723 



Working ("W") ; 

EAOS 



NOW 

3.608 

4.064 

3.951 

4.488 

4.605 

4.136 

4.087 

4.351 

3.806 

3.910 

4.061 

4.375 

3.981 

3.788 

3.800 

3.820 

4.299 

4.380 

3.526 

3.714 

4.500 

4.156 

4.467 

4.632 

4.797 

4.654 

4.791 



Mean Difference 



3.458 

3.791 

3.589 

4.253 

4.368 

4.044 

3.843 

4.114 

3.700 

3.690 

3.705 

4.071 

3.872 

3.702 

3.633 

3.600 

3.985 

3.919 

3.294 

3.596 

4.247 

3.909 

4.145 

4.309 

4.529 

4.378 

4.513 



II Mil 
•1 


HUM 

n 


-0.223 


0.150 


-0.089 


0.273 


-0.164 


0.362 


-0.095 


0.235 


-0.105 


0.237 


0.079 


0.092 


-0.088 


0.244 


-0 142 


0.237 


0.098 


0.106 


0.090 


0.220 


0.118 


0.356 


-0.009 


0.304 


0.340 


0.109 


0.370 


0.086 


0.099 


0.167 


-0.091 


0.220 


-0.169 


0.314 


-0.282 


0.461 


0.000 


0.232 


-0.117 


0.118 


-0.238 


0.253 


-0.214 


0.247 


-0.125 


0.322 


-0.222 


0.323 


-0.211 


0.268 


-0.160 


0.276 


-0.270 


0.278 



!n = 55 
2 n = 89 



Composite Mean: Group w 



Group N 



Overall Mean: 



NOW 4.176 

EOS 3.935 

NOW 3.816 

EOS 3.884 



NOW 
EOS 



3.996 
3.910 
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TIME IN IRR 

Table D-10-6 provides a breakdown of EO personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
those IRRs who have been off active duty more than 3 years. These mean 
values are shown for information only, since the number of individuals in 
each group is too small to permit meaningful quantitative interpretation. 



Table 0-10-6 

Mean Proficiency Values for EO IRR Respondents by Time Since EAOS 



Time (Mos.) 

Since EAOS* Mean No. of Cases 



0-5 


3.21 


28 


6-11 


3.52 


7 


12-17 


4.05 


3 


18-23 


4.15 


1 


24-35 


3.53 


5 


36+ 


3.41 


78 


Overall Mean 


3.40 


122 



*EA0S dates were not contained on the NAVMILPERSCOM data file 
for a large number of IRR EOs. Consequently, time since EAOS 
could not be determined. 



COIMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 
previously. They also suggest directions that should be taken with respect 
to the management and utilization of the IRR resource. 
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COMMENTS ON DATA BASE 

Approximately 12 percent of questionnaires returned were classified as 
"nonvalid" (table D-10-1). They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by 
respondents with comments such as: "No longer in IRR, returned to active 
duty, already received final discharge. Retiree recruited from another 
service, was never on active duty in the Navy." (All information concerning 
such cases was transmitted to the Naval Reserve Personnel Center on 26 
September 1985). Finally, a very few questionnaires were returned by 
individuals who refused to provide information and, some v by relatives 
marked, "Deceased." From the above data, it can be concluded that about 12 
percent of the EO IRRs could not or would not be available for a 
mobilization call. 

Questionnaires were presumably delivered by the Postal Service to a 
number of EOs (55 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above— they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as 1s currently believed. These 
considerations prompt a recommendation for review and validation of the EO 
IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that IRR EO respondents have been away from active duty. Th<s 
information is given in table D-10-6. Sixty-four percent were in the IRR 
for more than 3 years. Two issues emerge: (1) the need for skill upgrading 
and (2) availability of IRR members. Upgrade training because of new 
equipment, procedures, or material may be required for this group despite 
their beliefs (table D-10-6) in their continuing ability to perform job 
tasks at a fairly high level. 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, the 
recommendation is made that this data base be reviewed and validated if this 
is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-10-5. In table D-10-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR 
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Approximately 62 percent of EO IRRs reported that they now work in a 
civilian occupation related to their EO rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-10-5 
shows, EOs who now work in a field related to their Navy rating gained 
proficiency on all job tasks. The subgroup not working in a related field 
lost proficiency on 19 of the 27 tasks. Taken over all tasks, differences 
between the current (NOW) proficiency means for the two subgroups were 
statistically significant. Also, they could not be attributed to initial 
differences between the groups at EAOS. Thus, civilian EO-related 
employment significantly affected skill deterioration. Those continuing to 
work in the field after EAOS reported no deterioration. The tasks on which 
skill deterioration occurred for the subgroup not currently working in a 
related field are easily identifiable from table 0-10-5. 



TRAINING NEEDS 



While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the 
implications of skill deterioration data must be assessed against the 
criterion of acceptable level of proficiency. This can be done most 
directly by comparing the current proficiency levels reported by EO IRRs 
against the levels reported by active duty E0-3s. The task means for the 
active duty sample can be taken as E-4 criterion performance since they 
reflect the level of proficiency claimed by the average EO-3 now on active 
duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either table D-10-2 or 0-10-3. The answer key shows that a value 
of '4," for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
'4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower 
proficiency category. Skill loss occurred, for example, on tasks 4, 5, and 
6 for the IRRs not working in a related field. However, the losses reported 
resulted in the IRRs remaining in the "4" category (see table D-10-5). We 
would conclude that the deterioration is of no consequence insofar as 
signaling a need for retraining. 

Assessment of the need for training IRR personnel to support 
mobilization should proceed with the application of similar logic. Table 
D-1U-/ below presents the task mean values reported for current proficiency 
by IRR personnel who are not working in a field related to the EO rating and 
flSi- S r in th ? se ^ho a re working in a related field. These values ^re from 
taoie D-io-5. Task proficiency means for active duty personnel working in 
their rating (taken from table D-10-4) are also shown in table D-10-7. 
Inspection o' the data shows that values assigned by the two IRR groups are 
essentially the same as those assigned by the active duty group. Hence, 
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from these data alone, a fair conclusion is that training of E0 IRRs would 
not be required before mobilization to bring proficiency to an acceptable 
level . 

From our assessment, there seems to be no need for extensive retraining 
or maintenance training prior to mobilization. The average IRR E0 should be 
able to perform most of the required job tasks at an appropriate level of 
competency with a modicum of refamiliarization at mobilization. For the 
most part, this could probably be given by close, corrective supervision 
while the returnee is performing job tasks. This conclusion pertains to all 
EOs but is probably especially relevant to the 64 percent who continue to 
work in a related occupation. 



Table D-10-7 



Task Mean Proficiency Values for IRR and Active Duty EOs 



IRR 



Active Duty 
In Rating 



Tasks 



Not in Field 



In Field 



1 
2 
3 
4 
5 
6 
7 
8 

9a 
9b 
9c 
10a 
10b 
10c 
lOd 
lOe 
11a 
lib 
11c 
lid 
lie 
llf 
llg 
llh 
Hi 

llj 
Ilk 



3.3* 

3.5 

3.4 

4.2 

4.3 

3.9 

3.9 

4.1 

3.5 

3.6 

3.4 

4.1 

3.7 

3.9 

3.7 

3.4 

3.9 

3.9 

3.5 

3.2 

4.2 

3.5 

4.0 

4.1 

4.2 

4.3 

4.5 



3.6 
4.1 
4.0 
4.5 
4.6 
4.1 
4.1 
4.4 
3.8 
3.9 
4.1 
4.4 
4.0 
3.8 
3.8 
3.8 
4.3 
4.4 
3.5 
3.7 
4.5 
4.2 
4.5 
4.6 
4.8 
4.7 
4.8 



3.7 
4.2 
3.1 
4.7 
4.6 
4.0 
3.7 
4.3 
3.3 
3.5 
3.6 
4.3 
3.8 
3.5 
3.6 
3.4 
4.0 
4.4 
3.6 
3.1 
4.7 
4.0 
4.3 
4.5 
4.8 
4.8 
4.9 



♦Probable training needs. 
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An additional factor to consider in assessing needs for training, 
however, concerns time since EAOS. Sixty-four percent of the EO IRRs were 
away from active duty for more than 3 years (see table D-10-6). Subject 
matter experts who review the data provided here may determine that skill 
upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 

VALIDATION OF DATA 

Our analyses indicate that the need for training of EO IRRs against 
mobilization requirements is not great. It would appear that required 
proficiency (i.e., the level shown by current job incumbents) can for the 
most part be achieved by familiarization training under direct corrective 
supervision in quite short time periods for most job tasks. There are no 
indications that comprehensive training for all rating tasks, such as would 
be provided in a formal school setting (e.g., "A 11 School), is needed. 
Information not readily available to the project staff is needed, however, 
for firm decisions about the need for training to bring prospective IRR 
returnees to an acceptable level of proficiency or to maintain their skills 
at a defined level. We recommend that the information provided by this 
report be evaluated/validated against a number of other considerations. 
Resource sponsors would be appropriate to validate training needs. 

Data Review 

As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data are limited because of the small numbers of questionnaires returned and 
because of suspected IRR data base inadequacies. It is believed, however, 
that much useful information can be gleaned from the descriptive summaries 
provided. Most of this information has not previously been available 
because of the many difficulties inherent in conducting skill deterioration 
research and restrictions on methods that can be used because of practical 
considerations. Maximum exploitation of the information that is now 
available is in order. A complete and accurate assessment of the meaning 
and action implications of the data should be made by individuals who are 
thoroughly knowledgeable of technical requirements of the EO rating. The 
NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to be 
considered in the review/ validation process are discussed next. 

Review Areas 

For our study, SMEs from the Naval Construction Center, Gulf port, MS, 
identified the job tasks they thought would be appropriate for returning IRR 
EO members to perform. Other SMEs may not agree on the list. Resource 
sponsors should determine if these are indeed the job tasks that an IRR 
returnee (at mobilization) should be able to perform. Further, a companion 
decision is required concerning the acceptability of the reported level of 
competency. Since active duty personnel report that they, on the average, 
now perform at these levels, the data reflect E-4 criterion performance. 
Resource sponsors should consider whether less proficiency would be 
acceptable. If so, attendant training requirements for IRRs with 
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concomittant resource requirements would be lessened. On judging the need 
for training, task critical ity, in terms of personnel or equipment safety as 
it interacts with recent changes to material, procedures, or equipment, must 
also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these Individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Further, while decisions must still be made concerning formal 
training, either institutional or via OJT, our belief is that this type of 
training can be limited. 

Finally, based on (1) the IRR members' reports of their current 
relatively high residual levels of proficiency and (2) literature findings 
that maximum skill loss occurs after about 1 year of nonuse of skills, it 
appears that skill maintenance training for EOs is not strictly necessary. 
Again, however, this conclusion must be weighed against planned utilization 
of recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the EO IRR 
manpower pool may be smaller than believed. Approximately 12 percent of the 
pool may not be contactable by mail. An additional segment of unknown size 
may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage (26 percent) of EOs listed in IRR files 
could also be beyond the zone of Involuntary recall. 

2. EO IRR personnel who work in civilian occupations related to their 
rating reported proficiency gains on all job tasks. EOs not working in a 
related field reported only small proficiency losses. 

3. Comprehensive retraining and maintenance training for IRR EOs 
appear to be unnecessary to support mobilization. Familiarization training, 
at recall, consisting of supervised practice may suffice. This conclusion 
is subject to concurrence by subject matter expert EOs. 

4. EO personnel off active duty for greater than 3 years may require 
training on selected tasks to update skills if there have been substantial 
changes in building techniques despite their reported continuing high 
proficiency levels. Basic building skills probably do not require 
retraining. 
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5. Of the 27 EO job tasks for which skill deterioration was assessed, 
indications are that none will require any concerted training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 

6. For all EO IRRs, mean values of current proficiency reported 
compared favorably with those reported by active duty personnel. This 
finding also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the manpower pool are available at 
all times. Take whatever other steps are necessary and available to assure 
continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, oDtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall . 

3. Request resource sponsors review the data of this study. 
Determine if agreement can be reached that the tasks generated by 
school house SMEs adequately represent the EO-3 job. Determine that the EO-3 
job is, in fact, acceptable as the target performance level for training to 
support mobilization. Request resource sponsors consider the data of this 
study against factors such as changes to materials, procedures, equipment 
used by the rating, critical ity of task performance, and mobilization plans 
for IRR personnel . 

4. Consider recalling a sample of EO IRRs to assess their knowledge 
of current job requirements. Use this information to validate the data and 
conclusions of this study. 
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APPENDIX 0 
ANNEX 11 



ELECTRONICS TECHNICIAN (ET): 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by 0P-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Electronics Techni- 
cian (ET) rating was one of these 16. 



PURPOSE OF THE STUDY 



The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 



In 

recalled 



a general sense, acceptable proficiency refers to the ability of a 
ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance pro- 
ficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 



APPROACH 



Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail -out questionnaires were used to obtain information. Six senior 
enlisted ETs, assigned to the Service School Command, Naval Training Center, 
Great Lakes, IL, served as subject matter experts (SME) for questionnaire 
development. Under guidance given by the project staff, the ET SMEs 
selected from various source materials a set of job tasks that, in their 
judgment, best represented the job (non-NEC specific) of an active duty 
ET-3. This level was chosen in the belief that a recalled ready reservist 
who could perform ET job tasks competently at the E-4 level would make a 
positive work contribution to a receiving unit. 
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The ET-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel* Information sought concerned tasks performed and 
the level of competency attached to the performance of each* Level of com- 
petency was defined in terms of the amount of supervision needed to perform 
specific job tasks. 

Questionnaires mailed to IRR personnel requested information about pro- 
ficiency on each job task at the End of Active Obligated Service (EAOS) and 
at the present time (NOW). The difference between proficiency at EAOS and 
current proficiency would reflect skill deterioration during IRR membership. 

Questionnaires mailed to active duty ET-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty ET-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 25 September 1984, 519 ETs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN). Questionnaires were mailed under 
CNO (0P-11) cover letter on 21 November 1984 to the population of 519. 
Because of a low initial return rate, a follow-up mailing (332) was made on 
29 January 1985. Questionnaire returns were accepted until 28 February 
1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), and 
within CNO (0P-01) was accomplished for authorization to survey active duty 
ET-3 personnel. An ET-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 6,893, a sample of 455 ET-3s was deter- 
mined using accepted survey research methods. Questionnaires were mailed on 
18 September 1985 under CNO (0P-11) cover letter to unit/activity commanding 
officers for distribution to ET-3s named. Returns were accepted until 31 
December 1985. Returned questionnaires were scanned to determine data 
usability, and data were entered into computer files. Subsequently, sum- 
maries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of ET skill deterioration are pre- 
sented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table D-il-1 shows, for both the IRR and active duty ETs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid returns (nonvalid principally because 
of data base errors) is also shown. Percent usable returns was derived by 
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dividing the number returned (235) by the number delivered (i.e., 519 - 52 
467). 



Table D-ll-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonval id 
No. % 


IRR 


519 


235 


50 


52 10 


Active Duty 


455 


316 


70 





QUESTIONNAIRE DATA SIWARIES 



Summaries of data obtained from the questionnaires are presented in 
table D-ll-2 for IRR personnel and in table D-ll-3 for active duty 
personnel. The tables are modified questionnaire forms. 




Background Questions 



Of 228 IRR uls answering the question, 138 (approximately 61 percent) 
reported that they now work in a civilian occupation related to their Navy 
ET rating. Answers to the remaining two background questions for IRRs (see 
table D-ll-2) are not reported since it was determined that the answers 
might be redundant and could not be unambiguously interpreted. Of the 
active duty respondents answering the background questions (see table D-ll- 
3), 290 of 313 (92.7 percent) work in rating. Eighty-seven (28 percent) are 
assigned sea duty. 



Task PerfCiTance Data 



# 



ERIC 



The data summary tables (D-ll-2 and D-ll-3) show the number (F) and 
percent (%) of respondents reporting that they had never performed particu- 
lar job tasks (i.e., they responded to the task description with a "1.") For 
IRRs, these data refer to the "at EAOS" answers and for active duty to the 
current (NOW) level of ability. A rank-order correlation (see Siegel, 1956) 
computed between the two sets of data (r = .830, p < .05) indicated 
significant agreement between the two classes of respondents. Thus, tasks 
which have not been performed frequently by active duty ETs (to date) are 
the same tasks that had not been performed frequently by IRRs at EAOS. 

Tables D-ll-2 and D-ll-3 also show, for each task listed on a question- 
naire, mean values for performance proficiency/competency, the standard 
deviation (SD) around the mean, and the number of cases (n) on which a mean 
is based. For the IRR sample, table D-ll-2, the "A" column reflects current 
average ability level; the "B" column, EAOS average ability level. For the 
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Table D-ll-2 
Overall Summary of ET IRR Questionnaire Data 



PAST 1: 



ANSWER KEY: 



1* If necessary, comet four Service 
Bumber. 

2. If ttM nock Which you do BOU related 
to your Bavy rating? 

Too Ul. Bo JUL 

3. Have you dons PUVX0U8 tract Which if 
related to your levy rating 

since your Expiration of Active 
Obligated torvlca (lADt)t 

YM Bo - 

4. Havo you rocolvad troiaing roiatod to 
your Bevy rating since your Expiration 
of Aetlvo Obligated Service (EAD8)T 

Yea - Mo 



(1) Have never performed the taek. 

(2) Can/could do simple porta of the task 
(need direct supervision). 

(3) Can/could do mo*t parte of the task 
(need general eupervlaion). 

(4) Can/could do all parte of the task 
(need only occasional supervision. 
Meets minimum local speed and accuracy 
standards.) 

(5) Can/coulo do coaplete task quickly and 
accurately (need no supervision). 



PAST 2: 

For each job task statement below: 

A. Indlcete your CUBISBT level of ability according to the answer key ebove. 

B. Estimate your P1EVIW8 level of ability at the tine of your F*os eccordlng to 
the answer key ebove* 



M (l>" Choices 






A 






I 


% 




Tasks 


1 


Mean 


SD 


I 


21 


9.1 


1. 


Install and record field changes. 


232 


3.86 


1.305 


231 


1'. 


4.8 


2. 


Perform operational tests of 
electronic equipment 


232 


4.10 


1.139 


231 


51 


22.3 


3. 


Operate distribution patching and 
switching systems. 


230 


3.11 


1.445 


229 


10 


4.3 


4. 


Localise equipment casualties to 
sub-ssscmblies or porta and repair. 


231 


4.02 


1.183 


231 


11 


4.8 


S. 


Align/adjust electronic equipment. 


231 


4.09 


1.115 


231 


9 


3.9 


t. 


Test/trouMeshoot elec'-onic 
components* 


231 


4.09 


1.165 


230 


12 


5.2 


7. 


Locate shorts or opens in cobles. 


232 


4.48 


1.040 


232 



B 

Mean 8D 



26\j 
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25 


11.0 


8. 


iMOVt 8Wd rOpiSCO CSbiOS *fld 


228 


4.04 


1.333 


228 


4.07 


1.347 


53 


23.0 


9, 


TAit and sdiujfc avncnro/Mrvo 

oystoas. 


230 


2 ft£ 


i ion 


230 


3 IV 


1 A£S 

& . 


23 


10.0 


?0. 


Uii sriaATV lad tltotnati oowtr 
sourcos. 


*<iv 


3.88 




230 


3 on 


1 399 


18 


7.8 


11. 


Mate chongos to technical sod 
mintonsncs publ Lest ions and 
instructions * 


233 


4.12 


1.319 


231 


4.16 


1.297 


5 


2.2 


12. 


Uso technical publicstions . 


233 


4.45 


1.021 


232 


4.52 


.916 


6 


2.8 


13. 


Us8 electronic diagram. 


231 


4.35 


1.044 


230 


'4.45 


.995 


14 


8.0 


14. 


CosjUeto ■alntonanco data font. 


732 


3.72 


1.228 


232 


4.18 


1*159 


14 


8.1 


15. 


Ordor parts, tools* and supplies. 


232 


3.98 


1.204 


231 


4.30 


1.147 


10 


4.3 


18. 


Inspect » dean, and lubricate 
electronic equlpaamt. 


232 


4.41 


1.007 


231 


4.50 


.995 


5 


2.2 


17. 


Uso end aw in tain nandtools. 


233 


4.70 


.811 


230 


4.87 


.838 


27 


11.7 


18. 


Have s taste taiovlodge of digits! 
cone opts . 


232 


3.93 


1.350 


231 


3.84 


1.429 


15 


8.5 


19. 


Use, tost, sad ropsir gonoral 
purpose tost oquipssmt. 


232 


3.95 


1.218 


230 


4.10 


1.208 


8 


3.4 


20. 


Uso basic soldorlnt techniques. 


233 


4.58 


.940 


232 


4.54 


.993 



Ovorsll Hsan: 4.03 
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Table D-ll-3 

Overall Summary of ET Active Duty Questionnaire Data 



PAR 1: 



AMSUIS KEY: 



1. If necessary, correct your service 
Mbir. 

2. Does your current billot require you 
to wort in your levy rating? 

too 200 10 23 

3. What typo duty la your currant 
billotr 

aaa 07 Shore 224 



(1) Hava navar performed tha task. 

(2) Can/could do flap la parta of tha teak 
(naad diroct supervision) . 

(3) Can/could do wont parta of *he taak 
(naad general suparvlslorj . 

(4) Can/could do all porta of tha teak 
(naad only occasional aupanrlaion. 
Meets minimum local apaad and accuracy 
standards. ) 



(5) Can/could do complete taak quickly and 
accurately (naad no auparvialoa) • 



PAR 2: 

for oach job taak statement below: 

A. Use the anawar key above to indicate your CUUIR level of ability. 

B. Uae the anawar key above to eatiaate your tXPSCTBD level of ability after 2 
yeara of nftt per forming theae taaka. 



"(1)** Choicea A h 

I % Taaka V mean ID a Mean SO 

100 31.8 1. Install and record field changes. 314 3.09 1.583 312 2.92 1.331 

6 1.9 2. Perform operational tests of 315 4.57 .810 314 3.82 1.032 

electronic equipments* 

42 13.3 3. Operate distribution patching and 315 3.63 1.328 313 2.99 1.204 
switching sys terns. 

7 2.2 4. Localise equipment casualties to 315 4.3a .88a 312 3.07 1.013 

sub-assemblies or parts and repair. 

8 2.$ 5. Align/adjuat electronic equipment. 312 4.39 .907 311 3.71 1.057 

5 l.t 8. Teat/troubleehoot electronic 315 4.43 .812 312 3.82 1.042 
components. 

12 3.8 7. Locate short* or opene in eablee. 315 4.58 .911 313 4.37 1.030 

35 11.1 8. teaovs and replace cables and 314 4.02 1.324 311 3.75 1.338 
transmission lines. 
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Table D-ll-3 (Continued) 



133 


42.4 


9. Teit and adjust synchro/servo 
sy stone. 


314 


2.48 


1.454 


308 


2.22 


1.236 


28 


8.9 


10. Dm primary and altarnata power 
aoureaa. 


314 


4.03 


1.253 


309 


3.83 


1.238 


Si 


17*8 


11. Haka changes to technical and 
Maintenance publications and 
inatruetlooa. 


315 


3.78 


1.501 


311 


3.58 


1.376 


s 


1.8 


12. Usa tactanleal publleationa. 


318 


4.71 


.888 


314 


4.33 


.921 


4 


1.3 


13. Usa alaetronle diagrams. 


315 


4.84 


.898 


313 


4.24 


.941 


29 


9.2 


14. Complete Mintananea data forms. 


314 


3.79 


1.212 


313 


3.13 


1.158 


27 


8.5 


15. Order pacta, tools, and suppllas. 


318 


4.12 


1.253 


312 


'3.4. 


1.255 


6 


1.9 


18. Inapact, clean, and lubricate 
alaetronle aqulpnant. 


313 


4.70 


.738 


313 


4.40 


\919 


4 


1.3 


17. Usa and aalaUln hand tools. 


315 


4.S0 


.591 


312 


4.88 


.709 


7 


2.2 


18. Have a baale taovledge of digital 
concepts. 


318 


4.15 


1.003 


314 


3.55 


1.172 



19 6.0 19. Uae, test, and repair general 316 3. 81 i.iOS 313 3,37 x.Wl 

purpose test aqulpnant. 

9 2.8 20. Uaa baale soldering techniques . 316 4.47 .913 313 4.18 1.007 
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active duty sample (table 0-11-3), the "A" column refers to current (NOW) 
ability and the "B" to proficiency expected after 2 years of nonperformance 
of a task. 1 A Pearson Product Moment Correlation (r = .655, p < .05) 
computed between task means for IRR EAOS and active duty NOW (current 
proficiency) values indicated that the IRR members, while on active duty, 
performed job tasks at competency levels equivalent to those of current job 
incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single nt'uber indicates that 
considering the ET-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean ■ 4.0). 

For the active duty group, means reflecting proficiency on each job 
task for ETs working/not working in their rating were computed. These are 
shown in table . -11-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

T ble D-ll-5 displays task proficiency means for two subgroups of the 
ET IRR respondents: (1) those who answered that they were now working ("W") 
in a field related to the Navy ET rating and (2) those who indicated that 
they were not working ("N") in a related field. Both EAOS and NOW (current) 
proficiency means are given. These means, as well as those in table 0-11-4, 
were computed from choices of 2, 3, 4, or 5 from the answer key. These 
choices place proficiency along a continuum from "Need direct supervision" 
through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-ll-5, values pre- 
ceded by a minus sign represent a decrease in proficiency during IRR member- 
ship: current proficiency is less than EAOS proficiency. Values with no 
signs indicate increases in proficiency. 

The table shows that ETs who now work ("W") in a field related to their 
former active duty jobs actually gained proficiency on 10 of the 20 job 
tasks. Although the differences are not large, this "W" group also reported 
less skill deterioration over all other rating tasks than the "N" group. 
Statistical tests (t tests for independent means; see Guilford and Fruchter, 
1973) indicated thai over all tasks of the rating, the proficiency of the 
two subgroups was equivalent at EAOS (t = 1.655, p<.0531). Task mean pro- 
ficiency values, however, differed significantly ft ■ 4.07, p < .00011) for 
current (NOW) proficiency. 



iThese expected-after-2-years proficiency values were not used in 
subsequent analyses, however, since it wa? clear that many respondents did 
not understand the question being asked. 
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Table D-ll-4 

Task Mean Values for Two Subgroups of Active Duty ETs 





Not Working ("N") 1 




Working ("W") 2 


Task 


NUN 


EXP 




NOW 


EXP 


1 


4.000 


3.313 




4.070 


3.450 


2 


4.476 


3.476 




4.649 


3.929 


3 


3.667 


3.059 




4.052 


3.327 


4 


4.100 


3.429 




4.463 


3.754 


5 


4.100 


3.526 




4.505 


3.794 


6 


4.095 


3.476 




4.510 


3.870 


7 


4.524 


3.952 




4.746 


4.554 


8 


4.278 


3.778 




4.405 


4.081 


9 


3.333 


2.750 




3.534 


3.006 


10 


3.941 


2.938 




4.352 


3.906 


11 


4.250 


3.353 




4.398 


3.969 


12 


4.545 


3.818 




4.787 


4.423 


13 


4.348 


3.826 




4.719 


4.326 


14 


o ion 

o. /By 


3.105 




4.099 


3.335 


15 


4.294 


3.556 




4.428 


3.740 


1 C 

16 


4.545 


3.909 




4.794 


4.518 


17 


4.696 


4.391 




4.867 


4.752 


18 


4.045 


3.524 




4.243 


3.649 


19 


3.700 


3.000 




4.011 


3.570 


20 


4.227 


3.818 




4.599 


4.292 




Composite Mean: 


Group W 


NOW 


4.412 










EXP 


3.912 








Group N 


NOW 


4.148 










EXP 


3.500 






Overall Mean: 




NOW 


4.280 





EXP 3.706 



*n = 23 
2 n = 290 
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Table D-ll-5 
Task Mean Values for Two Subgroups of IRR ETs 





Not Working ("N") 1 


Working ("W") 2 


Mean 


Difference 


i ask 


NOW 

nun 


EAOS 


NOW 

nun 


LnUO 


II LI II 

"N" 


"W 


i 


3.882 


4.325 


4.366 


4.408 


-0.443 


-0.042 


2 


3.880 


4.459 


4.519 


4.614 


-0.579 


-0.095 


3 


3.484 


3.892 


3.833 


4.098 


-0.408 


-0.265 


4 


3.624 


4.321 


4.474 


4.418 


-0.697 


0.056 


5 


3.738 


4.310 


4.575 


4.594 


-0.572 


-0.019 


6 


3.644 


4.214 


4.541 


4.530 


-0.570 


0.011 


7 


4.437 


4.565 


4.761 


4.677 


-0.128 


0.084 


8 


4.256 


4.408 


4.468 


4.476 


-0.152 


-0.008 


9 


3.233 


3.623 


3.575 


3.842 


-0.390 


-0.267 


10 


4.056 


4.236 


4.344 


4.235 


-0.180 


0.109 


11 


4.342 


4.346 


4.573 


4.492 


-0.004 


0.081 


12 


4.302 


4.545 


4.787 


4.640 


-0.243 


0.147 


13 


4.125 


4.443 


4.687 


4.609 


-0.318 


0.078 


14 


3.855 


4.337 


4.044 


4.378 


-0.482 


-0.334 


15 


3.890 


4.525 


4.333 


4.530 


-0.635 


-0.197 


16 


4.318 


4.605 


4.706 


4.712 


-0.287 


-0.006 


17 


4.730 


4.764 


4.889 


4.744 


-0.034 


0.145 


18 


3.769 


3.795 


4.433 


4.109 


-0.026 


0.324 


19 


3.744 


4.108 


4.381 


4.442 


-0.364 


-0.061 


20 


4.575 


4.648 


4.787 


4.677 


-0.073 


0.110 






Composite Mean: 


Group W 


NOW 4.454 







EOS 4.461 

Group N NOW 3.994 

EOS 4.323 

Overall Mean: NOW 4.224 

EOS 4.39' 



in = 90 
2n = 138 



<* O J 
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TIME IN IRR 



Table D-ll-6 provides a breakdown of ET personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time and for 
those IRRs who have been off active duty more than 3 years. Trends in skill 
deterioration over time are not apparent. 





Table D-ll-6 




Mean Proficiency Values for ET IRR Respondents by Time Since EAOS 


Time (Mos.) 
Since EAOS 


Mean 


No. of Cases 


0-5 


3.87 


22 


6-11 


4.26 


7 


12-17 


4.31 


17 


18-23 


3.66 


13 


24-35 


4.20 


21 


36+ 


4.02 


140 


Overall Mean 


4.03 


220 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available 
previously. They also suggest directions that should be taken with respect 
to the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

Approximately 10 percent of questionnaires returned were classified as 
"nonvalid" (table D-ll-1). They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
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included, but to a much smaller extent, questionnaires returned by respond- 
ents with comments such as "No longer in IRR: returned to active duty, 
already received final discharge. Retiree recruited from another service, 
was never on active duty in the Navy." (All information concerning such 
cases was transmitted to the Naval Reserve Personnel Center on 26 September 
1985). Finally, a very few questionnaires were returned by individuals who 
refused to provide information and, some, by relatives marked, "Deceased." 
From the above data, it can be concluded that about 10 percent of the ET 
IRRs could not or would not be available for a mobilization call. 

Questionnaires were presumably delivered by the Postal Service to a 
number of ETs (45 percent) from whom n« information was received. It is 
likely that many did not respond for reasons such as those cited above— they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable Irr manpower pool as is currently believed. These consid- 
erations prompt a recommendation for review and validation of the ET IRR 
roster. 

Another data base issue that should be examined concerns the amount of 
time that IRR ET respondents have been away from active duty. This infor- 
mation is given in table D-6-6. Sixty-four percent were in the IRR for more 
than 3 years. Two issues emerge: (1) the need for skill upgrading and (2) 
availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group despite their beliefs 
(table 0-11-6) in their continuing ability to perform job tasks at a fairly 
high level. 

A second consideration concerns the Military Service Obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The actual size of the available irr manpower pool may be overestimated. 
Again, the recommendation is made that this data base be reviewed and 
validated if this is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-ll-5. In table D-ll-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 61 percent of ET IRRs reported that they now work in a 
civilian occupation related to the ET rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-ll-5 
shows, ETs who now work in a field related to their Navy rating gained 
proficiency on ten job tasks and also reported less skill deterioration for 
all other ET job tasks than the "N M subgroup. Taken over all tasks, differ- 
ences between the current (NOW) proficiency means for the two subgroups were 
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statistically significant. Also, they could not be attributed to initial 
differences between the groups at EAOS. Thus, civilian ET-related employ- 
ment significantly affected skill deterioration. Those continuing to work 
in the ET field after EAOS reported less deterioration. The tasks on which 
the greatest amount of skill deterioration occurred are easily identifiable 
from table D-ll-5. 



TRAINING NEEDS 



While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the impli- 
cations of skill deterioration data must be assessed against the criterion 
of acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by ET IRRs against the 
levels reported by active duty ET-3s. The task means for the active duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average ET-3 now on active duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or train- 
ing needs can be addressed. Attention is directed to the "answer key" shown 
on either table D-ll-2 or D-ll-3. The answer key shows that a value of "4," 
for example, represents skilled performance with only a need for occasional 
supervision. Following conventional practice, we assume that a "4" is 
reflected by any values between 3.50 and 4.49. A "3" is interpreted simi- 
larly. Skill deterioration may be shown by lower mean values for NOW (i.e., 
current) versus EAOS proficiency. However, the change from EAOS scores may 
not be sufficient to move the IRR respondents to a lower proficiency cate- 
gory. For example, skill loss on tasks 14 and 15 occurred for the IRRs 
working in a related field. However, the losses reported resulted in the 
IRRs remaining in the "4" category (see table D-ll-5). We would conclude 
that the deterioration is of no consequence insofar as signaling a need for 
retraining. 

Assessment of the need for training IRR personnel to support mobili- 
zation should proceed with the application of similar logic. Table D-ll-7 
below presents the task mean values reported for current proficiency by IRR 
personnel who are not working in a field related to the ET rating and also 
for those who are working in a related field. These values are from table 
0-11-5. Task proficiency means for active duty personnel working in their 
rating (taken from table D-ll-4) are also shown in table D-ll-7. Inspection 
of the data shows that all values are essentially "4"s. Hence, from these 
data alone, a fair conclusion is that training of ET IRRs would not be 
required before mobilization to bring proficiency to an acceptable level. 

From cm* assessment, there seems to be no need for extensive retraining 
or maintenance training of ETs prior to a mobilization recall. The average 
IRR ET should be able to perform required job tasks at an appropriate level 
of competency with a modicum of ref ami liar ization at mobilization. For the 
most part, this could probably be given by close, corrective supervision 
while the returnee is performing job tasks. This conclusion pertains to all 
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ETs but is probably especially relevant to the 61 percent of IRR ETs who 
continue to work in an ET-related occupation. 



Table D-ll-7 

Task Mean Proficiency Values for IRR and Active Duty ETs 





IRR 




Active Duty 


Tasks 


Hat in Field 

IIU 1* III 1 1 v 1 U 


Tn Fiplri 
in r i c i u 


in Rating 


1 


3.9 


4.4 


4.1 


2 


3.9 


4.5 


4.6 


3 


3.5 


3.8 


4.1 


4 


3.6 


4.5 


4.5 


5 


3.7 


4.6 


4.5 


6 


3.6 


4.5 


4.5 


7 


4.4 


4.8 


4.7 


8 


4.3 


4.5 


4.4 


9 


3.2 


3.6 


3.5 


10 


4.1 


4.3 


4.4 


11 


4.3 


4.6 


4.4 


12 


4.3 


4.8 


4.8 


13 


4.1 


4.7 


4.7 


14 


3.9 


4.0 


4.1 


15 


3.9 


4.3 


4.4 


16 


4.3 


4.7 


4.8 


17 


4.7 


4.9 


4.9 


18 


3.8 


4.4 


4.2 


19 


3.7 


4.4 


4.0 


20 


4.6 


4.8 


4.6 



An additional factor to consider in assessing needs for training, how- 
ever, concerns time since EA0S. Sixty-four percent of the ET IRRs in the 
sample were away from active duty for more than 3 years (see table D-ll-6). 
Subject matter experts who review the data provided here may determine that 
skill upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 

VALIDATION OF DATA 

Our analyses indicate that the need for training of ET IRRs against 
mobilization requirements is not great. It would appear that required pro- 
ficiency (i.e., the level shown by current job incumbents) can for the most 
part be achieved by familiarization training under direct corrective super- 
vision in quite short time periods for most job tasks. There are no indi- 
cations that comprehensive retraining for all rating tasks, such as would be 
provided in a formal school setting (e.g., "A" School), is needed. At worst 
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case, instructional modules for training prospective ET returnees on given 
individual tasks may be required. Information not readily available to the 
project staff is needed, however, for firm decisions about the need for 
training to bring prospective IRR returnees to an acceptable level of pro- 
ficiency or to maintain their skills at a defined level. We recommend that 
the information provided by this report be evaluated/validated against a 
number of other considerations. Resource sponsors would be appropriate to 
validate training needs. 

Data Review 

As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the ET rating. 
The NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to 
be considered in the review/validation process are discussed next. 

Review Areas 

For our study, SMEs from the Service School Command, Naval Training 
Center, Great Lakes, IL, identified the job tasks they thought would be 
appropriate for returning IRR ET members to perform. Other SMEs may not 
agree on the list. Resource sponsors should determine if these are indeed 
the job tasks that an IRR returnee (at mobilization) should be able to per- 
form. Further, a companion decision is required concerning the accept- 
ability of the reported level of competency. Since active duty personnel 
report that they, on the average, now perform at these levels, these data 
reflect E-4 criterion performance. Resource sponsors should consider 
whether less proficiency would be acceptable. if so, attendant training 
requirements for IRRs with concomittant resource requirements would be 
lessened. On judging the need for training, task critical ity, in terms of 
personnel or equipment safety as it interacts with recent changes to 
material, procedures, or equipment, must also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignmerts, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
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where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Further, while decisions must still be made concerning formal train- 
ing, either institutional or via OJT, cur belief is that this type of train- 
ing can be limited. 

Finally, based on (1) the IRR members' reports of their current rela- 
tively high residual levels of proficiency and (2, literature findings that 
maximum skill loss occurs after about 1 year of nonuse of skills, it appears 
that skill maintenance training for ETs is not strictly necessary. Again, 
however, this* conclusion must be weighed against planned utilization of 
recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the ET IRR 
manpower pocl may be smaller than believed. Approximately 10 percent of the 
pool may not be contactable oy mail. An additional segment of unknown size 
may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage of ETs listed in IRR files could also be 
beyond the zone of involuntary recall. 

2. ET IRR personnel who work in civilian occupations related to their 
ET rating reported less deterioration of skills than ETs who are not simi- 
larly employed. 

3. Comprehensive retraining and maintenance training for all IRR ETs 
appear to be unnecessary to support mobilization. Familiarization training, 
at recall, consisting of supervised practice may suffice. This conclusion 
is subject to concurrence by subject matter expert ETs. 

4. ET personnel off active duty for greater than 3 years may require 
training on selected tasks because of the volatility of the field to updat 
skills despite their reported continuing high proficiency levels. 

5. Of the 20 ET job tasks for which skill deterioration was assessed, 
indications are that none will require any concerted training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 

6. For all ET IRRs, mean values of current proficiency reported com- 
pare favorably with those reported by active duty personnel. This finding 
also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 
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2. Amend existing procedures where possible to obtain information 
from irr members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall. 

3. Request resource sponsors review the data of this study. Deter- 
mine if agreement can be reached that the tasks generated by schoolhouse 
SMts adequately represent the ET-3 job. Determine that the ET-3 job is, in 
fact, acceptable as the target performance level for training to support 
mobilization. Request resource sponsors consider the data of this study 
against factors such as changes to materials, procedures, equipment used by 
the rating, criticality of task performance, and mobilization plans for IRR 
personnel . 

4. Consider recalling a sample of ET IRRs to assess their knowledge 
of current ET-3 job requirements. Use this information to validate the data 
and conclusions of this study. 
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APPENDIX D 
ANNEX 12 



FIRE CONTROL TECHNICIAN (SURFACE MISSILE) (FTM): 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 

Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntaril enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject o recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR con- 
dition of nonuse. This raises the question of the contribution that can be 
made by recalled IRR service members. To determine the extent and nature of 
skill deterioration during IRR membership, the Naval Training Systems Center 
(NAVTRASYSCEN), Code 10, conducted an assessment study. The study was per- 
formed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Fire Control Tech- 
nician (Surface Missile) (FTM) rating was one of these 16 critical ratings. 
(This rating is now subsumed under the general "FC" designation.) 

PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance pro- 
ficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. ( 

APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Four senior 
enlisted FTMs, assigned to the Service School Command, Naval Training 
Center, Great Lakes, IL., served as subject matter experts (SME) for ques- 
tionnaire development. Under guidance given by the project staff, the FTM 
SMEs selected from various source materials a set of job tasks that, in 
their judgment, best represented the job (non-NEC specific) of an active 
duty FTM-3. This level was chosen in the belief that a recalled ready 
reservist who could perform FTM job tasks competently at the E-4 level would 
make a positive work contribution to a receiving nit. 
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The FTM-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of com- 
petency was defined in terms of the amount of supervision needed to perform 
specific job tasks. 

Questionnaires mailed to IRR personnel requested information about pro- 
ficiency on each job task at the End of Active Obligated Service (EAOS) and 
at the present time (NOW). The difference between proficiency at EAOS and 
current proficiency would reflect skill deterioration during IRR membership 

Questionnaires mailed to active duty FTM-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty FTM-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 25 September 1984, 219 FTMs were listed in Naval Military Person- 
nel Command (NAVMILPERSCOM) computer files as assigned to the IRR. Names 
and addresses were obtained from NAVMILPERSCOM through *he Naval Reserve 
Personnel Center (NAVRESPERSCEN). Questionnaires were mailed under CNO 
(0P-11) cover letter on 31 December 1984 to the population of 219. Because 
of a low initial return rate, a follow-up mailing (168) was made on 29 
January 1985. Questionnaire returns were accepted until 2c February 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT) , and 
within CNO (0P-01) was accomplished for authorization to survey active duty 
FTM-3 personnel. An FTM-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 1,308, a sample of 378 FTM-3s was deter- 
mined using accepted survey research methods. Questionnaires were mailed on 
18 September 1985 under CNO (0P-11) cover letter to unit/activity commanding 
officers for distribution to FTM-3s named. Returns were accepted until 31 
December 1985. Returned questionnaires were scanned to determine data 
usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of FTM skill deterioration are pre- 
sented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table 0-12-1 shows, for both the IRR and active duty FTMs, the number 
of questionnaires mailed and number and percent of usable returns. For the 
IRR sample, the number/percent of nonvalld returns (nonvalid principally 
because of data base errors) is also shown. Percent usable returns was 
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derived by dividing the number returned (73) by the number delivered (i.e., 
219 - 17 = 202). 

Table D-12-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 
% 


Nonvalid 
No. % 


IRR 


219 


73 


36 


17 7.8 


Active Duty 


378 


260 


69 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table 0-12-2 for IRR personnel and in table D-12-3 for active duty person- 
nel. The tables are modified questionnaire forms. 

Background Questions 

Of 69 IRR FTMs answering the question, 38 (approximately 55 percent) 
reported that the/ now work in a civilian occupation related to their Navy 
FTM rating. Answers to the remaining two background questions for IRRs (see 
table 0-12-2) are not reported since it was determined that the answers 
might be redundant and could not be unambiguously interpreted. Of the 
active duty responoents answering the background questions (see table 0-12- 
3), 247 of 255 (97 percent) work in rating. Two hundred and forty-seven (96 
percent) are assigned shore duty. 

Task Performance Data 

The data summary tables (D-12-2 and 0-12-3) show the number (F) and 
percent [%) of respondents reporting that they had never performed particu- 
lar job tasks (i.e., they responded to the task description with a "1.") 
For IRRs, these data refer to the "at EAQS H answers and for active duty to 
the current (NOW) level of ability. A rank -order correlation (see Siegel, 
1956) computed between the two sets of data (r ■ .895, p < .05) indicated 
significant agreement between the two classes of respondent*. Thus, tasks 
which have not been performed by active duty FTMs (to date; are the same 
tasks that had not been performed by IRRs at EAOS. 

Tables 0-12-2 and 0-12-3 also show, for each task listed on a question- 
naire, mean values for performance proficiency/competency, the standard 
deviation (SD) around the mean, and the number of cases (n) on which a mean 
is based. For the IRR sample, table 0-12-2, the "A" column reflects current 
average ability level; the M B" column, EAOS average ability level. For the 



9 

ERJ.C 



D-12-5 

280 



Technical Report 86-007 



Table D-12-2 
Overall Summary of FTM IRR Questionnaire Data 



PART 1: 

1. If necceeery, comet your Service 



2. lo tbo wort which you 4o VOW roUtod 
to your levy rating? 

Too 30 Oo 31 

3. Neve you done FHflotjg work which io 
related to your levy ratine 

■iaeo your laplretion of Active 
Obligated Sorvlco (lAOS)f 

Too - Wo - 

4. Novo you received training role tod to 
your levy rating since your Expiration 
of Active Obligated Sorvlco (lAOO)f 

TOO - No - 



A18UBS MY: 

(1) Hove novor parforaad tho took. 

(2) con/could do olapla porto of tho took 
(nood direct ouporvloloa). 

(3) Con/could do wft parte of tho took 
(nood general ouporvloloa) . 

(4) Con/could do oil porto of tho took 
(nood only occasional ouporvloloa. 
Hooto alnlMM loeol opood and oceurocy 



(5) 



Ce**/could io conplcta took quickly ond 
oceurotoly (nood no ouporvloloa). 



PAST 2s 

for each job took etat 
A. Indlcoto your 

t. lotion to your FUVI0U0 lovol of oblllty at tho tine of your KAOl eccordlng to 
tho onowor koy ohovo . 



t below: 

lovol of oblllty according to tbo earner koy above. 



"(1)" Cholcoo 
E * 



Tooko 



7 10.0 1. Toot end align redor lndlcetlns 
clrculto. 

1 1.4 2* lopelr or replace electrlcel/ 

electronic eoapoaoate ond porto. 



3 0.9 3* Toot high power W enpllfler 

f llaaoat volteee end high voltage 
protective clrculto. 



control ofuipejent for 
continuity, groundc, and Ohorte. 



3 


0.9 


4. 


1 


1.4 


3. 


2 


2.0 


0. 


3 


4.2 


7. 



Moon 00 



8D 



•9 


3.22 


1.293 


70 


3.93 


71 


4.27 


1.002 


72 


4.30 


71 


3.30 


1.324 


72 


3.99 


71 


3.03 


1.40S 


72 


4.24 


72 


4.47 


.970 


72 


4.03 


72 


4.19 


1.102 


72 


4.30 


72 


4.04 


1.209 


72 


4.29 



281 



0-12-6 



Technical Report 86-007 
Table D-12-2 (Continued) 



2 2.8 8. Sepalr electrical/electronic cablee 
and connectors. 

11 15.5 9. Prepare computer for all modes of 
operations. 

21 29.2 10. Load operational and diagnostic 
programs la digital eoaputera. 

2 2.8 11. On block dtsgroms, echometlce, 
logic and wiring dUgwaj. 

1 1.4 12. teed dUla and Indicator*. 



2 2.8 13. Perform ay to— oaerablllty toata 
on weapons control/ f Ira control 
equipment. 



12 14.7 14. Operate weapons direction/ 

designation sy s t ems Including 
recognition of MOL olgnalo. 

It 25.4 15. energise stable eleneote. 

10 14.3 la. Operate mlaalla teat and readlneee 

14 lt.7 17. Verify benchmark reeding, tree 
element, and record data. 

14 19.7 18. Operate Target Designation 

Transmit tore (TP?). 

15 20.8 19. Clean end teat optical equipment. 

1 1.4 20. Clean and lubricate mechanical 

and/or electro mechanical 
assemblies. 

2 2.9 21. Uae and maintain hand too la, 

8 ll.l 22. Inspect liquid coolant aye tome, 

19 27.1 23. measure low preaeure dry air 
eyot 



24. What claaa ahlp<o? were you ont 

Overall 



72 


4.34 


1.039 


72 


4.42 


1.031 


71 


3.17 


1.414 


71 


3.47 


1.433 


72 


3.21 


1.433 


72 


3.28 


1.213 


72 


4.13 


1.150 


72 


4.40 


1.030 


72 


4.40 


.847 


72 


4.74 


•492 


72 


3 43 


1.283 


72 


4.42 


•940 


72 


3.00 


1.332 


72 


3.54 


1.414 


71 


2.79 


1.453 


71 


3.14 


1.537 


71 


3.20 


1.527 


70 


3.91 


1.422 


71 


2.92 


1.S28 


71 


3.44 


1.500 


71 


3.27 


1.430 


71 


3.73 


1.585 


72 


3.21 


1.528 


72 


3.54 


1.545 


72 


4.13 


1.150 


72 


4.40 


.614 


72 


4.74 


.712 


72 


4.74 


.779 


72 


3.93 


1.449 


72 


4.19 


1.307 


71 


3.07 


1.445 


70 


3.43 


1.444 


ant 


3.48 
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Table D-12-3 

Overall Summary of FTM Active Duty Questionnaire Data 



PAR 1: 



AlWSt KEY: 



1. If Mceesary, correct your Service 
Mbtr. 

2. Does your current billet require you 
to work in your Bevy rating? 

Tee 147 So ■ 

3. what type duty Is your current 
bllletf 

See 9 Shore 247 



(1) Have never performed the task. 

(2) Can/could do simple parts of the teas; 
(need direct supervision) . 



(3) Can/could do east parte of the teak 
(need general supervision). 



(4) Can/could do ell parte of the teak 
(need only occasional supervision. 
Meets minimum local s peed and acci 
standards.) 



accuracy 



(3) Can/could do couple to task quickly and 
accurately (need no supervision). 



PAW 2: 

For each *ob teak sta tenen t below: 

A. Use >he answer key above to indlcete your CUtXEaT level of ability. 



B. Use the answer key above to estimate your DPSCTID level of ability after 2 
yearn of not performing these tasks. 



-(!)- Choices a • 



t 


% 




Teaks 


a 




SO 


a 




SO 


39 


15.1 


1. 


feat and sllgn radar indicating 
circuits. 


238 


3.38 


1.373 


231 


2.97 


1.193 


2 


.0 


2. 


tepsir or replace electrlcsl/ 
electronic components and parts. 


240 


4.37 


.743 


237 


4.04 


1.003 


21 


• •1 


3. 


Teet high power tP amplifier 
filament voltage end high voltage 
protective circuits. 


239 


3.94 


1.204 


234 


3.33 


1.241 


If 


7.3 


4. 


Test and adjust radar power supplies. 


23* 


4.28 


X.201 


234 


3.81 


1.247 


2 




3. 


Use g'Nfteral purpose test eoulpment. 


240 


4.74 


.409 


234 


4.27 


.843 


5 


l.t 


4. 


Test weepoas control equipment for 
continuity, grounds* and shorts. 


239 


4.32 


.832 


234 


4.08 


1.029 


13 


5.8 


7. 


Inspect and maintain rotating 
msfihlnepy . 


237 


4.22 


1.101 


234 


3.71 


1.204 



# 



ERIC 
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Table 0-12-3 (Continued) 



12 


4.7 


1. 


lepalr electrlcal/alectronle cables 
and comae ton. 


258 


4.19 


1.091 


252 


3.87 


1.194 


39 


15.1 


9. 


Prepare conputar Cor all modal of 
operations. 


258 


3.51 


1.458 


253 


2.97 


1.275 


57 


22.1 


10. 


Load operational and diagnostic 
pragma in digital computers. 


258 


3.47 


1.832 


250 


3.08 


1.405 


1 


.4 


11. 


Use block diagra— , scbsmatics, 
logic and wiring diagrams. 


259 


4. tO 


.721 


258 


4.05 


.983 


1 


.4 


12. 


mead dUla and indicators. 


2tO 


4.89 


.420 


255 


4.80 


.758 


9 


3.5 


13. 


Parfora systems opereblllty tasts 
on weapons control/flra control 
squ lament. 


2t0 


4.37 


.991 


255 


3.55 


1.078 


74 


26.4 


14. 


Operate weapons dlractlon/ 
dasignation sfsrsms including 
racognition of sXX signals. 


259 


3.02 


1.522 


252 


2.51 


1.208 


124 


47.7 


15. 


margisa ataxia alaaants. 


2t0 


2.87 


1.728 


247 


2.41 


1.508 


114 


44.4 


It. 


Oparata missile tast and raadinass 


257 


2.73 


1.714 


244 


2.43 


1.381 


105 


40.7 


17. 


Verify benches r* goading, tram 
element, and racord data. 


258 


2.84 


1.585 


250 


2.41 


1.354 


103 


39.4 


It. 


Oparata Targat Dasignation 
Transmitters <WT>. 


2tO 


2.99 


1.775 


251 


2.75 


1.588 


94 


34.2 


19. 


Claan and tast optical equipment. 


2t0 


3.11 


1.759 


252 


2.93 


1.810 


5 


l.t 


20. 


Claan and lubricate macbanical 
and/or alactro mechanical 
easemblies. 


2t0 


4.55 


.835 


258 


4.10 


1.038 


2 


.1 


21. 


Use and maintain handtools. 


2t0 


4.91 


.430 


257 


4.80 


.583 


43 


It. 5 


22. 


Inspact liquid coolant systems. 


2t0 


3.97 


1.477 


252 


3.81 


1.388 


72 


28.1 


23. 


measure low* pressure dry air 
systems. 


258 


3.42 


1.444 


249 


3.15 


1.478 



24. What cUti «hl»(«) van you oat 
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active duty sample (table D-12-3), the "A" column refers to current (NOW) 
ability and the "B" to proficiency expected after 2 years of nonperformance 
of a task.l. A Pearson Product Moment Correlation (r = .905, p < .05) com- 
puted between task means for IRR EAOS and active duty NOW (current profi- 
ciency) values indicates that the IRR members, while on active duty, 
performed job tasks at competency levels equivalent to those of current job 
incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the FTM-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean = 3.68). 

For the active duty group, means reflecting proficiency on each job 
task for FTMs working/not working in their rating were computed. These are 
shown in table D-12-4. Again, the expected-after-2-years data are provided 
for Information only. 

SKILL DETERIORATION 

Table D-12-5 displays task proficiency means for two subgroups of the 
FTM IRR respondents: (1) those who answered that they were now working 
("W") in a field related to the Navy FTM rating and (2) those who indicated 
that they were not working ("N") 1n a related field. Both riAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-12-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key. These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-12-5, values 
preceded by a minus sign represent a decrease in proficiency during IRR 
membership: current proficiency 1s less than EAOS proficiency. Values with 
no signs indicate Increases in proficiency. 

The table shows that FTKs who now work ("W") in a field related to 
their former active duty jobs gained proficiency on 6 of the 23 job tasks 
rated. This group also reported less skill deterioration over all but one 
of the other rating tasks than the 11 N M subgroup. Statistical tests (t tests 
for Independent means; see Guilford and Fruchter, 1973) Indicated thai over 
all tasks of the FTM rating, the proficiency of the two subgroups was 
equivalent at EAOS (t « 1.30, 2^- 10 °2)* Task mean proficiency values 
differed s1gn1f1cantly~(t « 4.176, j> <. 000069) on current (NOW) proficiency. 



1 These expected-after-2-years proficiency values were not used in 
subsequent analyses, however, since it was clear that many respondents did 
not understand the question being asked. 
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Table D-12-4 

Task Mean Values for Two Subgroups of Active Duty FTMs 

Not Working ("N") 1 Working ("W") 2 

Task NOW EXP NOW EXP 



1 


4.143 


3.286 




4.029 


3.252 


2 


4.750 


4.375 




4.596 


4.045 


3 


4.250 


3.625 




4.187 


3.536 


4 


4.286 


4.167 




4.544 


4.013 


5 


4.714 


4.429 




4.768 


4.272 


6 


4.625 


4.000 




4.593 


4.169 


7 


4.375 


3.875 




4.428 


3.893 


8 


4.625 


4.125 




4.348 


4.004 


9 


3.000 


2.857 




3.981 


3.302 


10 


4.143 


3.571 




4.147 


3.464 


11 


4.750 


4.250 




4.624 


4.092 


12 


5.000 


4.875 




4.902 


4.618 


13 


4.750 


4.125 




4.475 


3.649 


14 


4 000 






^ Q99 




15 


4.429 


4.143 




4.198 


3.516 


16 


4.750 


4.000 




4.083 


3.309 


17 


3.857 


3.375 




3.776 


3.204 


18 


4.000 


3.286 




4.331 


3.743 


19 


4.800 


4.333 




4.279 


3.813 


20 


4.625 


4.250 




4.612 


4.169 


21 


5.000 


4.875 




4.935 


4.826 


22 


5.000 


4.500 




4.544 


3.990 


23 


4.143 


3.750 




4.372 


3.736 




Composite Mean. 


Group W 


NOW 


4.373 










EXP 


3.811 








Group N 


NOW 


4.435 










EXP 


3.981 






Overall Mear.; 




NOW 


4.404 





EXP 3.896 



*n = 8 
2 n = 247 
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Table D-12-5 
Task Mean Values for Two Subgroups of IRR FTMs 





Not Working ("N") 1 


Working ("W") 2 




Mean 


Difference 


Tack 


NOW 


EA0S 


NOW 


£A0S 




II Mil 

n 


11,111 

n 


l 


ft 1 A ft 

3.143 


A 1 AO 

4.103 


3.818 


4.382 




-0.960 


-0.564 


2 


ft A 

3.774 


A r£ ft 

4.563 


A ft A ft 

4.842 


A £ ft ft 

4.692 




-0.789 


0.150 


3 


3.167 


A 1 ft /> 

4.100 


A 1 C ft 

4. 152 


A ft ft T 

4.297 




-0.933 


-0.145 


4 


3.483 


4.448 


A f- 1 f- 

4.515 


4.500 




-0.965 


0.015 


5 


4.129 


4.625 


4.923 


4.718 




-0.496 


0.205 


6 


A ft ft ^ 

4.097 


A C A ft 

4.548 


A /" ft ft 

4.622 


A T 41 A 

4.744 




-0.451 


-0.122 


7 


A AA "? 

4.097 


4.355 


4.351 


4.500 




-0.258 


-0.149 


8 


4.031 


4.531 


A Tift 

4.718 


4.500 




-0.500 


0.218 


9 


Air 

3.045 


ft ftl T 

3.917 


ft AAf 

3.946 


3.917 




-0.872 


0.029 


10 


3.645 


4.059 


4.167 


4.294 




-0.414 


-0.127 


11 


3.633 


4.129 


4.744 


4.795 




-0.496 


-0.051 


12 


4.438 


4.781 


4.821 


4.795 




-0.343 


0.026 


13 


3.552 


4.516 


4.108 


4.513 




-0.964 


-0.405 


14 


ft AOI 

3.037 


4.034 


3.697 


4.065 




-0.997 


-0.368 


15 


3.391 


3.880 


3.571 


3.893 




-0.489 


-0.322 


16 


ft a a r\ 

3.440 


4.385 


3.969 


4.412 




-0.945 


-0.443 


17 


3.318 


3.885 


3.833 


4.161 




-0.567 


-0.328 


18 


4.000 


4.370 


4.172 


4.433 




-0.370 


-0.261 




3.889 


4.370 


3.793 


4.067 




-0.481 


-U. 


20 


3.967 


4.531 


4.487 


4.744 




-0.564 


-0.257 


21 


A 7CH 
*f • / DU 


4.875 


4.821 


4.868 




-0.125 


-0.047 


22 


4.333 


4.643 


4.382 


4.556 




-0.310 


-0.174 


23 


3.947 


4.143 


4.250 


4.467 




-0.196 


-0.217 






Composite Mean: Group W NOW 


4. 


291 












EOS 


4. 


448 










Group N NOW 


3.752 












EOS 


4. 


339 








Overall 


Mean: 


NOW 


4. 


022 












EOS 


4. 


394 





In * 31 
2 n = 38 
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TIME IN IRR 



Table 0-12-6 provides a breakdown of FTM personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
IRRs off active duty more than 3 years. These mean values are shown for 
information only, since the number of individuals in each group is too small 
to permit meaningful quantitative interpretation. 

Table D-12-6 

Mean Proficiency Values for FTM IRR Respondents by Time Since EAOS 



Time (Mos.) 
Since EAOS 


Mean 


No. of 


0-5 


4.05 


9 


6-li 


3.17 


4 


12-17 


3.66 


7 


18-23 


4.17 


6 


24-35 


3.79 


12 


36+ 


3.49 


27 


Overall Mean 


3.68 


65 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rate coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available previ- 
ously. They also suggest directions that should be taken with respect to 
the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

Approximately 8 percent of questionnaires returned were classified as 
'nonvalid" (table D-12-1). They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
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returned by the Postal Service as unde liver able (bad addresses). It also 
included, but to a much smaller extent, questionnaires returned by respond- 
ents with comments such as: "No longer in IRR, returned to active duty, 
already received final discharge. Retiree recruited from another service, 
was never on active duty in the Navy." (All information concerning such 
cases was transmitted to the Naval Reserve Personnel Center on 26 September 
1985.) Finally, a very few questionnaires were returned by individuals who 
refused to provide information and, some, by relatives marked, "Deceased." 
From the above data, it can be concluded that about 8 percent of the FTM 
IRRs could not or would not be available for a mobilization call. This can 
probably be considered as an acceptable percentage. 

Questionnaires were presumably delivered by the Postal Service to a 
number of FTMs (64 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above--they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These 
considerations prompt a recommendation for review and validation of the FTM 
IRR roster. 

Another data base issue that should be examined concerns the amount of 
time that FTM respondents have been away from active duty. This information 
is given in table D-12-6. Forty-two percent were in the IRR for more than 3 
years. Two issues emerge: (1) the need for skill upgrading and (2) avail- 
ability of IRR members. Upgrade training because of new equipment, proce- 
dures, or material may be required for this group despite their beliefs 
(table D-12-6) in their ability to perform job tasks at an acceptable level. 
FTM SMEs must make this determination, however, based on changes to how the 
job is now performed. 

A second consideration concerns the Military Service Obligation (MSO). 
Those who are liable for a 6- or 8- year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be ov restimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-12-5. In table D-12-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 55 percent of FTM IRRs reported that they now work in a 
civilian occupation related to the FTM rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-12-5 
shows, FTMs who now work ( M W M ) in a field related to their Navy rating 
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gained proficiency on 6 of the 23 job tasks. They also reported less skill 
deterioration than the "N 11 subgroup for all but one of the other FTM job 
tasks. Taken over all tasks, differences between the current (NOW) profi- 
ciency means for the two subgroups were statistically significant. Also, 
they could not be attributed to initial differences between the groups at 
EAOS. Thus, civilian FTM-related employment sir ^ficantly affected skill 
deterioration. Those continuing to work in the FTM field after EAOS 
reported less deterioration. The tasks on which the greatest amount of 
skill deterioration occurred are easily identifiable from table D-12-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the impli- 
cations of skill deterioration data must be assessed against the criterion 
of acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by FTM IRRs aaainst the 
levels reported by active duty FTM-3s. The task means for the active duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average FTM-3 now on active duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or train- 
ing needs can be addressed. Attention is directed to the "answor key" shown 
on either table D-12-2 or D-12-3. The answer key shows that a value of "4, 11 
for example, represents skilled performance with only a need for occasional 
supervision. Following conventional practice, we assume that a "4" is 
reflected by any values between 3.50 and 4.49. A M 3 M is interpreted simi- 
larly. Skill deterioration may be shown by lower mean values for NOW (i.e., 
current) versus EAOS proficiency. However, the change from EAOS scores may 
not be sufficient to move the IRR respondents to a lower proficiency cate- 
gory. For example, skill loss on tasks 13 to 23 occurred for the IRRs 
working in a related field. However, the losses reported resulted in the 
IRRs remaining in the "4" category (see tabl* D-12-5). We would conclude 
that the deterioration is of no consequence insofar as signaling a need for 
retraining. 

Assessment of the need for training IRR personnel to support mobili- 
zation should proceed with the application of similar logic. Table D-12-7 
below presents the task mean value reported for current proficiency by IRR 
personnel who are not working in a field related to the FTM rating and also 
for those who are working in a related field. These values are from table 
D-12-5. Task proficiency means for active duty personnel working in their 
rating (taken from table D-l?-4) are also shown in table D-12-7. Inspection 
of the data shows that all values are essentially "4"s for FTM IRRs working 
in a related field. For IRR FTMs not working in a related field, 16 of the 
23 job tasks are "4"s. Hence from these data alone, a fair conclusion is 
that training of FTM IRRs working in a related field would not be required 
before mobilization to bring proficiency to an acceptable level. On the 
other hand, training of FTM IRRs not working in a related field would be 
recommended before mobilization. 
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From our assessmert, the current level of proficiency differs for FTM 
IRRs working/not working in a related field. There seems to be no need for 
extensive retraining or maintenance training of FTMs working in the field. 
In this case, the average IRR FTM should be able to perform required job 
tasks at an appropriate level of competency with a modicum of ^familiari- 
zation at mobilization. For the most part, this could probably be given by 
close, corrective supervision while the returnee is performing job tasks. 

The picture is different for FTM IRRs not working in the field. The 
average IRR FTM should not be able to perform almost a third of the required 
job tasks at mobilization. These FTMs should receive refresher training 
emphasizing the tasks identified in table D-12-7. A specialized curriculum 
using the data of this study to identify training emphasis areas is recom- 
mended for development. 



Table D-12-7 



Task Mean Proficiency Values for IRR and Active Duty FTMs 



IRR 



Active Duty 
In Rating 



Tasks 



Not in Field 



In Field 



1 



3.1* 

3.8 

3.2* 

3.5 

4.1 

4.1 

4.1 

4.0 

3.0* 

3.6 

3.6 

4.4 

3.6 

3.0* 

3.4* 

3.4* 

3.3* 

4.0 

3.9 

4.0 

4.8 

4.3 

3.9 



3.8 
4.8 
4.2 
4.5 
4.9 
4.6 
4.4 
4.7 
3.9 
4.2 
4.7 
4.8 
4.1 
3.7 
3.6 
4.0 
3.8 
4.2 
3.8 
4.5 
4.8 
4.4 
4.3 



4.0 
4.6 
4.2 
4.5 
4.8 
4.6 
4.4 
4.3 
4.0 
4.1 
4.6 
4.9 
4.5 
3.8 
4.2 
4.1 
3.8 
4.3 
4.3 
4.6 
4.9 
4.5 
4.4 



3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 



*Prooable training needs. 
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An additional factor to consider in assessing needs for training con- 
cerns time since EAOS. Forty-two percent of the FTM IRRs in the sample were 
away from active duty for more than 3 years (see table d-12-6). Subject 
matter experts who review the data provided here may determine that skill 
upgrade training is required because of technical changes (e.g., new equip- 
ment, materials, procedures) in the field. These upgrade training needs 
could also be incorporated into a specialized mobilization curriculum. 

VALIDATION OF DATA 

Our analyses indicate that there is a need for training some FTM IRRs 
to support mobilization. Formal refresher training appears to be the best 
solution for FTMs who do not work in jobs related to the FTM rating. 

For those who do work in a related job, it would appear that required 
proficiency (i.e., the level shown by current job incumbents) can for the 
most part be achieved by familiarization training under direct corrective 
supervision in quite short time periods for most job tasks. There is no 
indication that comprehensive retraining for all rating tasks, such as would 
be provided in a formal school setting (e.g., "A" school), is needed. At 
worst case, instructional modules for training FTM returnees (who have been 
working in the field) on given individual tasks may be required. 

Information not readily available to the project staff is needed for 
firm decisions about the need for training to bring prospective IRR 
returnees to an acceptable level of pr -iciency or to maintain their skills 
at a defined level. We recommend that the information provided by this 
report be evaluated/validated against a number of other considerations. 
Resource sponsors would be appropriate to validate training needs. 

Data Review 

As noted previously, the conclusions generated oy the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. it is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order* A complete and accurate assessment of the 
meaning and action implications of the data should be made t~y individuals 
who are thoroughly knowledgeable of technical requirements of the FTM 
rating. The NAVTRASYSCEN, if requested, could assist SMEs in this effort. 
Areas to be considered in the review/validation process are discussed next. 

Review Areas 

For our study, SMEs from Service School Command, Naval Training Center, 
Great Lakes, IL, identified the job tasks they thought would be appropriate 
for returning IRR FTM members to perform. Other SMEs may not agree on the 
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list. Resource sponsors should determine if these are indeed the job tasks 
that an IRR returnee (at mobilization) should be able to perform. Further, 
a companion decision is required concerning the acceptability of the 
reported level of competency. Since active duty personnel report that they, 
on the average, now perform at these levels, these data reflect E-4 
criterion performance. Resource sponsors should consider whether less pro- 
ficiency would be acceptable. If so, attendant training requirements for 
IRRs with concomittant resource requirements would be lessened. On judging 
the need for training, task critical ity, in terms of personnel or equipment 
safety as it interacts with recent changes to material, procedures, or 
equipment, must also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. A large part of this 
training could be done on the job or in on-the-job type conditions where IRR 
returnees could demonstrate their ability to perform job tasks under close, 
corrective supervision. It is our belief, based on available data that 
desired proficiency would be achieved relatively quickly on many tasks. 
Further, while decisions must still be made concerning formal training, 
either institutional or via OJT, our belief is that this type of training 
can be limited to the IRRs who have not continued in their specialty after 
EAOS • 

Finally, based on (1) the IRR members' reports of their current rela- 
tively high residual levels of proficiency and (2) literature findings that 
maximum skill loss occurs after about 1 year of nonuse of skills, it appears 
that skill maintenance training for all FTMs is not strictly necessary. 
However, we would recommend periodic maintenance training for FTM IRRs who, 
as civilians, receive no practice on Navy-related job skills. Again, how- 
ever, this conclusion must be weighed against planned utilization of 
recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training for all more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the FTM IRR 
manpower pool may be smaller than believed. Approximately 7 to 8 percent of 
the pool may not be contactable by mail. An additional segment of unknown 
size may have already reenlisted and/or not be useful to the Navy for other 
reasons. A substantial percentage of FTMs listed in IRR files could also be 
beyond the zone of involuntary recall. 

2. FTM IRR personnel who work in civilian occupations related to 
their FTM rating report less deterioration of skills than FTMs who are not 
similarly employed. on, 



ERJ.C 



D-12-18 



Technical Report 86-007 



3. For FTM IRRs working in rating-related jobs, mean values of 
current proficiency reported compare favorably with those reported by active 
duty personnel. This finding suggests minimal zieeds for retraining of tnis 
subgroup. Of the 23 FTM job tasks for which ski 1 1 deterioration war, 
assessed, indications are that, for IRRs working in civilian jobs related to 
the rating, none will require concentrated training for returning skills to 
an acceptable level of proficiency prior to mobilization recall. 

4. Retraining for FTMs who do not work in civilian occupations 
related to their FTM rating may be necessary prior to mobilization. Formal 
training consisting of refresher courses and supervised practice may be 
necessary. This conclusion is subject to concurrence by subject matter 
expert rTMs. Periodic maintenance training for the same FTMs may also be 
desirable. 

5. FTM personnel off active duty for greater than 3 years wi 1 1 
probably require training on SME-selected tasks to update skills. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that in the future accurate assessments of the size of the IRR anpower pool 
are available at all times. Take whatever other steps are necessary and 
available to assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall . 

3. Request resource sponsors review the data of this study. Deter- 
mine if agreement can be reached that the tasks generated by schoolhouse 
SMEs adequately represent the FTM- 3 job. Determine that the FTM-3 job is, 
in fact, acceptable as the target performance level for returning FTM IRRs. 
Request resource sponsors consider the data of this study against factors 
such as changes to materials, procedures, equipment used by the rating, 
criticality of tasK performance, and mooilization plans for IRR personnel. 

4. Tasi. the Naval Education and Training Command to develop a 
specialized FTM premobi 1 ization curriculum. 

b. Consider recalling a sample of FTM IRRs to assess their knowledge 
of current FTM-3 job requirements. Use this information to validate the 
data and conclusions of this study. 
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APPENDIX D 
ANNEX 13 



GAS TURBINE SYSTEM TECHNICIAN (ELECTRICAL) (GSE) 
SKILL DETERIORATION DURING NAV.' 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Re3dy Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN) , Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Gas Turbine System 
Technician (Electrical) (GSE) rating was one of these 16. 



PURPOSE OF THE STUDY 
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The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum acceptable proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance pro- 
ficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 



APPROACH 



Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Three senior 
enlisted GSEs, assigned to the Service School Command, Great Lakes, II, 
served as subject matter experts (SME) for questionnaire development. Under 
guidance given by the project staff, the SMEs selected from various source 
materials a set of job tasks that, in their judgment, best represented the 
job (non-NEC specific) of an active duty GSE-3. This level was chosen in 
the belief that a recalled r -dy reservist who could perform GSE job tasks 
competently at the E-4 leve] would make a positive work contribution to a 
receiving unit. 
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The 6SE-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of com- 
petency was defined in terms of the amount of supervision needed to perform 
specific job tasks. 

Questionnaires mailed to IRR personnel requested information about pro- 
ficiency on each job task at the End of Active Obligated Service (EAOS) and 
at the present time (NOW). The difference between proficiency at EAOS and 
current proficiency would reflect skill deterioration during IRR membership. 

Questionnaires mailed to active duty 6SE-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty 6SE-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 25 September 1984, 16 GSEs were listed in Naval Military Person- 
nel Command (NAVMILPERSCOM) computer files as assigned to the IRR. Names 
and addresses were obtained from NAVMILPERSCOM through the Naval Reserve 
Personnel Center (NAVRESPERSCEN). Questionnaires were mailed on 31 December 
1984 under CNO (0P-11) cover letter to all 16 IRR GSEs. A follow-up mailing 
(11] was made on 29 January 1985. Questionnaire returns were accepted until 
28 February 1985. Despite the small number, the IRR GSEs were included in 
the study at the specific request of 0P-01R1. Their inclusion permitted 
development of a data collection instrument that would be available for 
future use. It also permitted the collection of baseline information 
describing the active duty GSE-3 job. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), and 
within CNO (0P-01) was accomplished for authorization to survey active duty 
GSE-3 personnel. A GSE-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 338, a sample of 222 GSE-3s was deter- 
mined using accepted survey research methods. Questionnaires were mailed on 
18 September 1985 under CNO (0P-11) cover letter to unit/activity commanding 
officers for distribution to GSE-3s named. Returns were accepted until 31 
December 1985. Returned questionnaires were scanned to determine data 
usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of GSE skill deterioration are pre- 
sented in this section. All results presented concerning IRR GSEs must be 
considered as "information only" because of the very low samole size 
available. 
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QUESTIONNAIRE RETURN STATISTICS 



Table D-13-1 shows, for both the IRR and active duty GSEs, the number 
of questionnaires mailed and number and percent of usable returns. For the 
IRR sample, the number/percent of nonval id returns (nonval id principally 
because of data base errors) is also shown. Percent usable returns was 
derived by dividing the number returned (10) by the number delivered (i.e., 
16 - 1 = 15). 



Table D-13-1 



Questionnaire Return Statistics 



Sample 


No. Mailed 


• Usable 
No. 


Returns 

% 


Nonval id 
No. % 


IRR 


16 


10 


62 


1 6 


Active Duty 


222 


145 


63 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-13-2 for IRR personnel and in table D-13-3 for active duty person- 
nel. The tables are modified questionnaire forms. 

Background Questions 

Of 10 IRR GSEs answering the question, 3 (30 percent) reported that 
they now work in a civilian occupation related to their Navy GSE rating. 
Answers to the remaining two background questions for IRRs are not reported 
since it was determined that the answers might be redundant and could not be 
unambiguously interpreted. Of the active duty respondents answering the 
background questions (see table D-13-3), 128 of 141 (91 percent) work in 
rating. One hundred and thirty-five (94 percent) are assigned shore duty. 

Task Performance Data 

The data summary tables (D-13-2 and D-13-3) show the number (F) and 
percent (%) of respondents reporting that they had never performed particu- 
lar job tasks (i.e., they responded to the task description with a "1.") For 
IRRs, these data refer to the M at EA0S M answers and for active duty to the 
current (NOW) level of ability. A rank-order correlation (see Siegel, 1956) 
computed between the two sets of data (r = .154, p> .05) indicated no 
si]nificant agreement between the two classes of respondents. 
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Table D-13-2 
Overall Summary of GSE IRR Questionnaire Data 



PART 1: AESVER KEY; 



Have never performed the took. 

Can/ could do ilapU porta of the teak 
(need direct supervision) . 

Can/could do moot porta of the tosk 
(need general aupervioion). 

Can/could do ell porta of the took 
(need only occasional aupervioion. 
Heats minimum local opeed and eccurecy 
etanderdo . ) 

Can/ could do conplete teak quickly and 
eeeuretoly (need no aupervioion) . 



. PACT 2: 



For each job took statement below: 

A. Indieoto your CURREKT level of obility eceording to the enewer key ebove. 

B. Estimate your PREVIOUS level of obility ot the tie* of your EAOS eceording to 
the answer key ebove. 



1. If neeooaery. correct your Service (1) 
■umber. 

(2) 

2. la the work Which you do ECU releted 
to your levy rating? 

tea 3 Bo 7 (3) 

3. Have you done PREVIOUS work which ia 
releted to your levy rating (4) 
aince your Expiration of Active 

Obligated tervico (EAOS)T 

tea - Bo - 

4. Have you received training releted to (5) 
your levy rating oinee your Expiration 

of Active Obligated Service (EAOS)? 
Yea - lo - 



"(1)" Choieoo A B 

£ X Taeke ■ Mean SD E Mean SD 

1. Inapeet equipment component*. 10 4.10 .994 10 4.50 .972 

2. Perform preventive maintenance 10 4.10 .568 10 4.70 .483 
on control and monitoring circuit a . 

3. Maintain eKetrleel cebling, wiring, 10 4.40 .966 10 4.60 .966 
and connector* by locating ohorto 

and ground! . 

4. Measure current, voltage, phase 10 4.40 .966 10 4.50 .707 
angle impedance , and resistance 

in circuits. 

5. Operate automatic/manual bus transfer 10 4.90 .316 10 4.90 .316 
awi tehee . 

6. Determine battery conditio.* , log 10 4.70 .483 10 4.80 .422 
hydrometer readings, eetivete and 

place battery in service eo required. 
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7. Inspect and MtiUn insulation 10 4.40 1.075 10 4.60 .843 

resistance of motors and generators. 

1 10.0 8. Perform pravantlva maintenance on 10 3.70 1.418 10 4.10 1.197 

digital data equipment. 

9. use schematic diagrams, drawings, io 3.60 1.075 10 4.20 .919 
charts, and blueprints, 

10. Perform pre-o?e rational checks. 10 3.50 1.080 10 4.40 .966 
align support systems, and operate 

gas turbine UH 1088. 

11. Recognise fault indications from 10 3.60 .966 10 4.80 .422 
dials, gages, and controls at central 

control station, locate control 
stations, and ship's control console. 

12. Carry out casualty control procedures 10 3.60 1.174 10 4,50 .707 
at focal and central stations. 

1 10.0 13. Maintain logs. 10 4.00 1.3*3 10 4.20 1.229 

2 20.0 14. Detect corrosion and assist In 10 3.80 1.619 10 4.00 1.633 

arresting by using preservation 
materials . 

15. Opera ta, engineering control 10 3,50 .707 U 4.60 .699 

systems from the local operating 
station an4 CC8. 

1 10.0 16. Operate electrlcel generator io 3.50 1.179 10 4.40 1.26S 

from switchboard. 

1 10.0 17. Perform- sefety wiring of gas io 4.20 1.229 10 4.50 1,269 

turbine electrlcel connectors end 
mechanical fittings. 

1 10.0 18. Use test equipment for trouble- 10 4.10 1.287 10 4.40 .966 

shooting electrlcel equipment. 

1 10.0 19. ftepalr and replace sensors. 10 4.10 1.287 10 4.20 1.317 

1 10.0 20. Maintain power supplies for ges 10 4.10 1.370 10 4.30 1.337 

turbine electrical systems. 

1 10.0 21. Rig and unrig shore power. io 3.40 1.265 10 3.80 1.398 

Overall Mean: 3.99 
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Table D-13-3 

Overall Summary of GSE Active Duty Questionnaire Data 



PAST 1: 



1. If lueuHry, cornet your Service 
lumber. 

2. Does your current billet require you 
to work In your levy ret Inn? 

Yoe 121 Vo 13 

3. Whet type duty le your current 
billet? 

See 8 Shore 133 



AISWU KEY: 



(1) Heve never performed the teek. 

(2) Cen/ could do simple perte of the teek 
(need direct eupervieion) . 

(3) Cen/ could do aoet perte of the teek 
(need general supervision). 

(4) Cen/could do ell perte of the ttek 
(need only oecesionel supervision. 
Meets minimum locel speed end eccurecy 
stenderde*) 

(5) Cen/could do complete teek quickly end 
eccuretely (need no supervision). 



PART 2: 

For eech job tesk statement below: 

A. Use the enswer key above to irdieete your CUBUST level of ebillty. 

B. Use the enswer key ebove to estlnete your CCPICTBD level of ebillty efter 2 
yeers of not performing these tasks. 



"(I)" Choices A B 

£ % Tesks ■ Keen 8D V Keen SD 

5 3.4 1. Inepect equipment components. 145 3.98 1.003 140 3.(7 1.062 

11 7.4 2. Perform preventive maintenance 143 3.59 1.222 139 3.30 1.100 
on control end monitoring circuits. 

10 6.9 3. Melnteln electrlcel cebling. wiring, 145 3.67 X.Xtl 140 3.47 1.166 
end connectors by loeeclng shorts 
end grounds. 

8 5.6 4. Heesure current, voltage, phase 144 3.80 1.215 140 3.62 1.208 
eagle impedenco, end reeletence 

in circuits. 

22 15.3 5. Operete eutoaetlc/aenuel hue trenefer 144 3.74 1.476 139 3.68 1.286 
switches . 

20 13.8 6. Determine battery condition, log 145 3.99 1.474 140 3.S6 1.384 
hydrometer readings, ectlvete and 
piece battery in service ee required. 
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23 16.0 7. Inspect indmiun Insulation 144 3.68 1.471 140 3.56 1.405 

resistance of actors and generators. 

32 22.2 8. Parfora preventive Maintenance on 144 2.96 1.409 138 2.83 1.299 

digital data equlpaent. 

6 4.2 9. Usa acheaatic diagrams, drawings, 144 3.73 1.196 140 3.56 1.242 

charts* and bluaprlnts. 

8 5.4 10. Parfora pre-operational checks, 142 3.76 1.173 141 3.32 1.155 

align support systeas, an6 operate 
gas turblna IAW 1088. 

7 4.8 11. Recognise fault indications fron 145 3.83 1.133 140 3.35 1.150 

dials, gagas » and controls at cantral 
control station, locata control 
stations, and ship's control console. 

23 15.9 12. Carry out casualty control procedures 145 3.29 1.348 140 2.85 1.086 
at local and central stations. 

5 3.5 13. Maintain logs. 144 4.35 .985 141 3.95 1.091 

10 6.9 14. Detect corrosion and assist in 144 4.25 1.168 141 4.12 1.137 

arresting by using preservation 
aaterlals. 

22 15.2 15. Operate, engineering control 145 3.39 1.385 136 3.11 1.184 

systeas froa the local operating 
station and CCS. 

26 17.9 16. Operate electrical generator 142 3.44 1.504 137 3.19 1.303 

froa switchboard. 

6 4.1 17. Parfora safety wiring of gas 145 4.37 1.060 141 4.11 1.151 

turbine electrical connectors and 
Mechanical fittings. 

8 5.6 18. Use test equlpaent for trouble- 144 3.75 1.215 138 3.48 1.228 

shooting electrical equlpaent. 

16 11.0 19. Repair and replace sensors. 145 3.89 1.334 140 3.70 1.251 

23 15.9 20. Maintain power supplies for gss 145 3.39 1.361 140 3.17 1.297 

turbine electrical systeas. 

30 26.2 21. Rig and unrig shore power. 145 3.29 1.616 139 3.17 1.579 
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Tables D-13-2 and D-13-3 also show, for each task listed on a question- 
naire, mean values for performance proficiency/competency, the standard 
deviation (5D) around the mean, and the number of cases (n) on which a mean 
is based. For the IRR sample, table D-13-2, the "A" column reflects current 
average ability level; the "B" column, EAOS average ability level. For the 
active duty sample (table D-13-3), the "A" column refers to current (NOW) 
ability and the "B" to proficiency expected after 2 years of nonperformance 
of a task.l A Pearson Product Moment Correlation (r = .121, p> .05) 
computed between task means for IRR EAOS and active duty NOW (current profi- 
ciency) values indicates that the IRR members while on active duty did not 
perform job tasks at competency levels equivalent to those of current job 
incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the GSE-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean ■ 4.0). 
Note again, however, that this mean is based on only 10 IRR GSEs. Conse- 
quently, little credence can be given. 

For the active duty group, means reflecting proficiency on each job 
task for GSEs working/not working in their rating were computed. These are 
shown in table D-13-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table L-13-5 displays task proficiency means for two subgroups of the 
GSE IRR respondents: (1) those who answered that they were now working 
("W") in a field related to the Navy GSE rating and (2) those who indicated 
that they were not working ("N") in a related field. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-13-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key. These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-13-5, values pre- 
ceded by a minus sign represent a decrease in proficiency during IRR member- 
ship: current proficiency is less than EAOS proficiency. Values with no 
signs indicate increases in proficiency. The data are presented for infor- 
mation only. 



lThese expected-after-2-years proficiency values were not used in 
subsequent analyses, however, since it was clear that many respondents did 
not understand the question being asked. 
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Task Mean Values for Two Subgroups of Active Duty GSEs 



Not Working ("N") A Working ("W"r 

Task NOW EXP NOW EXP 



1 


3.444 


3.818 




4.134 


3.715 


2 


3.167 


3.750 




3.856 


3.445 


3 


4.000 


4.111 




3.872 


3.512 


4 


3.625 


3.800 




3.992 


3.752 


5 


3.500 


3.727 




4.282 


3.921 


6 


4.000 


4.273 




4.491 


4.159 


7 


4.167 


4.625 




4.216 


3.823 


8 


3.000 


3.750 




3.552 


3.131 


9 


3.909 


4.167 




3.863 


3.617 


10 


3.455 


3.583 




3.958 


3.397 


11 


3.727 


3.583 




4.000 


3.417 


12 


3.444 


3 500 




3 780 

\J m t \J\J 


1 MR 


13 


4.077 


4.167 




4.512 


4.008 


14 


4.583 


4.636 




4.479 


4.215 


15 


3.400 


3.545 




3.847 


3.277 


16 


3.000 


3.455 




4.086 


3.500 


17 


4.100 


4.000 




4.548 


4.281 


18 


4.333 


4.111 




3.929 


3.537 


19 


4.000 


4.250 




4.264 


3.882 


20 


4.250 


4.286 




3.852 


3.412 


21 


3.375 


4.111 




4.168 


3.779 




Composite Mean: 


Group W 


NOW 


4.080 










EXP 


3.657 








Group N 


NOW 


3.741 










EXP 


3.964 






Overall Mean: 




NOW 


3.910 





EXP 3.811 



In = 13 
2 n = 128 
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Table D-13-5 
Task Mean Values for Two Subgroups of IRR GSEs 





Not Working ("N") 1 


Working ("W") 2 


Mean 


Difference 


Task 


NOW 


EA0S 


NOW 


EA05 


"N" 


"W" 


1 


4.000 


4.333 


4.000 


4.667 


-0.333 


-0.667 


2 


4.167 


4.500 


3.667 


5.000 


-0.333 


-1.333 


3 


4.157 


4.333 


4.667 


5.000 


-0.166 


-0.333 


4 


4.667 


4.500 


3.667 


4.333 


0.167 


-0.666 


5 


4.833 


4.833 


5.000 


5.000 


0.000 


0.000 


6 


4.667 


4.833 


4.667 


4.667 


-0.166 


0.000 


7 


4.667 


4.667 


3.667 


4.333 


0.000 


-0.666 


8 


4.200 


4.600 


3.333 


4.000 


-0.400 


-0.667 


Q 


3.667 


4.000 


3.667 


4.667 


-0.333 


-1.000 


10 


3.667 


4.000 


3.333 


5.000 


-0.333 


-1.667 


11 


4.000 


4.667 


3.000 


5.000 


-0.667 


-2.000 


12 


3.833 


4.500 


2.667 


4.333 


-0.667 


-1.666 


13 


4.667 


4.667 


4.000 


4.500 


0.000 


-0.500 


14 


4.600 


4.600 


5.000 


5.000 


0.000 


0.000 


15 


3.667 


4.333 


3.333 


5.000 


-0.666 


-1.667 


16 


4.000 


4.800 


3.333 


4.667 


-0.800 


-1.334 


17 


4.500 


4.833 


4.500 


5.000 


-0.333 


-0.500 


18 


3.833 


4.167 


4.333 


4.667 


-0.334 


-0.334 


19 


4.167 


4.333 


5.000 


5.000 


-0.166 


0.000 


20 


4.500 


4.500 


4.000 


5.000 


0.000 


-1.000 


21 


3.833 


3.833 


3.500 


4.500 


0.000 


-1.000 



Composite Mean: Group W NOW 3.921 

EOS 4.730 

Group N NOW 4.205 

EOS 4.468 

Overall Mean: NOW 4.063 

EOS 4.599 



In = 7 
2n = 3 
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TIHE IN IRR 

Table D-13-6 provides a breakdown of GSE personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values, computed over all tasks of the rating, that were assigned for profi- 
ciency for each 6-month interval of IRR time. These mean values are shown 
for information only, since the number of individuals in each group is too 
small to permit meaningful quantitative interpretation. 

Table D-13-6 

Mean Proficiency Values for GSE IRR Respondents by Time Since EAOS 



Time (Mos.) 
Since EAOS 


Mean 


No. of C 


0-5 


2.86 


1 


6-il 


4.26 


3 


12-17 


4.67 


1 


18-23 


3.27 


2 


24-35 


4.39 


2 


36+ 


4.29 


1 


Overall Mean 


3.99 


10 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. Interpre- 
tations relating to IRR members are not warranted, however, because of the 
small number involved. Legitimate conclusions concerning skill deterio- 
ration and retraining needs cannot be made. Comments on the active duty 
data are provided, however. 

TRAINING NEEDS 

An important concern of this study was with determining the need for 
training GSE IRR personnel to acceptable proficiency levels prior to a 
mobilization recall. Although skill deterioration could not be assessed, 
data were obtained that define acceptable level of proficiency. The current 
proficiency levels reported by active duty personnel can be taken as E-4 
(GSE-3) criterion performance; they reflect the level of proficiency claimed 
by the average GSE-3 now on active duty. These data may be used to estab- 
lish the goals for any type of training program and also for assessing skill 
loss if data, and opportunity, are subsequently provided. 
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For effective future use of the data, the meaning of specific numerical 
values reported for task means must be clearly understood to reach conclu- 
sions about skill deterioration or training. Attention is directed to the 
"answer key" shown on either table D-13-2 or D-.13-3. The answer key shows 
that a value of "4," for example, represents skilled performance with only a 
need for occasional supervision. Following conventional practice, we assume 
that a M 4 M is reflected by any values between 3.50 and 4.49. A "3" is 
interpreted similarly. Thus, skill deterioration may be shown by lower mean 
values for NOW (i.e., current) versus EAOS proficiency. Howaver, the change 
from EAOS scores may not be sufficient to move the IRR respondents to a 
lower proficiency category. For example, skill loss on task 2 occurred for 
the IRRs not working in a related field (see table D-13-5). However, the 
losses reported resulted in the IRRs remaining in the "4 M category. We 
would conclude that the deterioration is of no consequence insofar as 
signaling, a need for retraining. 

Assessment of the need for training reserve personnel against mobili- 
zation would proceed with the application of similar logic. In this case, 
the task mean values for "current" proficiency (i.e., after skill deterio- 
ration has occurred) of IRR personnel would be compared to the values for 
active duty (working in rating) personnel. If the values, in each case, 
fall into the same proficiency categories, a fair conclusion would be that 
training of IRRs would probably not be required before mobilization to bring 
proficiency to an acceptable level. 

An additional factor to consider in assessing needs for training, how- 
ever, concerns time since EAOS. For IRRs who have been away from active 
duty for more than 3 years, skill upgrade training should be considered to 
respond to any technical rhanges (e.g., new equipment, materials, proce- 
dures) in the field. 

CONCLUSIONS 

1. Conclusions concerning skill deterioration and training needs of 
GSE IRRs cannot be provided because of the small number of individuals 
assigned to the IRR at the time of the study. 

2. Data obtained from the active duty sample of GSE-3s can be used to 
establish training programs for GSEs. They can also be used in future 
efforts to assess implications of skill loss information that may subse- 
quently become available. 

RECOMMENDATIONS 

1. Request resource sponsors review the data of this study. Deter- 
mine if agreement can be reached that the tasks generated by schoolhouse 
SMEs adequately represent the GSE-3 job. Determine that the GSE-? job is, 
in fact, acceptable as the target performance level for returning GSE IRRs. 



2. Consider recalling a sample of GSE IRRs to assess their knowledge 
of current GSE-3 job requirements. Use the data of this study as a baseline 
for decisions about skill loss and retraining needs. 
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APPENDIX D 
ANNEX 14 



HOSPITAL CORPSMAN (HM): 
SKILL DETERIORATION DURING NAVY 
INDIVIDUAL READY RESERVE (IRR) MEMBERSHIP 
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INTRODUCTION 

Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR con- 
dition of nonuse. This raises the question of the contribution that can be 
made by recalled IRR service members. To determine the extent and nature of 
skill deterioration during IRR membership, the Naval Training Systems Center 
(NAVTRASYSCEN) , Code 10, conducted an assessment study. The study was 
performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by 0P-01. The designation "critical" was based on the criterion 
of projected personnel shortfalls for mobilization. The Hospital Corpsman 
(HM) rating was one of these 16. 

PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance pro- 
ficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 

APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief description is presented here. 

Mail-out questionnaires were used to obtain information. Five senior 
enlisted HMs, assigned to the Regional Medical Center, Orlando, FL, served 
as subject matter experts (SME) for questionnaire development. Under guid- 
ance given by the project staff, the HM SMEs selected from various source 
materials a set of job tasks that, in their judgment, best represented the 
job (non-NEC specific) of an active duty HM-3. This level was chosen in the 
belief that a recalled ready reservist who could perform HM job tasks compe- 
tently at the E-4 level would make a positive work contribution to a 
receiving unit. 
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The HM-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about pro- 
ficiency on each job task at the End of Active Obligated Service (EAOS) and 
at the present time (NOW). The difference between proficiency at EAOS and 
current proficiency would reflect skill deterioration during IRR membership. 

Questionnaires mailed to active duty HM-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty HM-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of these data 
collection instruments are shown in the next section. 

As of 25 September 1984, 1,935 HMs were listed in Naval Military 
Personnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. 
Names and addresses were obtained from NAVMILPERSCOM through the Naval 
Reserve Personnel Center (NAVRESPERSCEN) . Questionnaires were mailed under 
CNO (0P-11) cover letter on 22 October 1984 to a random sample of 500 (26 
percent). Coordination with the Office of the Navy Surgeon General had 
previously been accomplished. Because of a low initial return rate, a 
follow-up mailing (320) was made on 29 January 1985. Questionnaire returns 
were accepted until 28 February 1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT) , and 
within CNO (OP-Oi) was accomplished for authorization to survey active duty 
HM-3 personnel. An HM-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 6,022, a sample of 456 HM-3s was deter- 
mined using accepted survey research methods. Questionnaires were mailed on 
18 September 1985 under CNO (OP-11) cover letter to unit/activity commanding 
officers for distribution to HM-3s named. Returns were accepted until 31 
December 1985. Returned questionnaires were scanned to determine data 
usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of HM skill deterioration are pre- 
sented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table D-14-1 shows, for both the IRR and active duty HMs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid returns (nonvalid principally because 
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of data base errors) is also shown. Percent usable returns was derived by 
dividing the number returned (214) by the number delivered (i.e., 500 - b4 = 
446). 



Table D-14-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 

% 


Nonvalid 
No. % 


IRR 


500 


214 


48 


54 11 


Active Duty 


456 


285 


63 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-14-2 for IRR personnel and in table D-14-3 for active duty person- 
nel. The tables are modified questionnaire forms. 

Background Questions 

Of 211 IRR HMs answering the question, 107 (approximately 51 percent) 
reported that they now work in a civilian occupation related to their Navy 
HM rating. Answers to the remaining two background questions for IRRs (see 
table D-14-2) are not reported since it was determined that the answers 
might be redundant and could not be unambiguously interpreted. Of the 
active duty respondents answering the background questions (see table D-14- 
3), 246 of 278 (88.5 percent) work in rating. One hundred and ninety-five 
(69 percent) are assigned sea duty. 

Task Performance Data 

The data summary tables (D-14-2 and D-14-3) show the number (F) and 
percent (%) of respondents reporting that they had never performed parti- 
cular job tasks (i.e., they responded to the task description with a "1.") 
For IRRs, these data refer to the "at EAOS" answers and for active duty to 
the current (NOW) level of ability. A rank-order correlation (see Siegel, 
1956) computed between the two sets of data (r = .924, p < .05) indicated 
significant agreement between the two classes 6? respondents. Thus, tasks 
which have not been performed by active duty HMs (to date) are the same 
tasks that had not been performed by IRRs at EAOS. 

Tables D-14-2 and D-14-3 also show, for each task listed on a question- 
naire, mean values for performance proficiency/competency, the standard 
deviation (SD) around the mean, and the number of cases (n) on which a mean 
is based. For the IRR sample, table D-14-2, the "A" column reflects current 
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Table D-14-2 
Overall Summary of HM IRR Questionnaire Oata 

Table D-14-2 overall 8usmry of HM IKK Queetionnaire Data 



PAST 1: 



AHSU1R KSY: 



1. If neceeeary, eorraet jour Sarviea 
Mbar. 

2. la tba Mork Which you do VOW ralatad 
to your levy rating? 

Yaa 12L_ lo 104 

3. Hava you dona PREVIOUS work which la 
ralatad to your lavy rating 

alnca your Expiration of Active 
Obligated sarviea (IAOS)T 

Tee - lo - 

4. Hava you racaivad training ralatad to 
your lavy rating ainca your Expiration 
of Active Obligated Sarviea (EAOS)T 

taa - lo - 



(1) Hava navar performed the taak. 

(2) Can/could do eim?le parte of the taak 
(nefcd direct supervision). 

(3) Can/could do most parte of the taak 
(need general supervision). 

(4) Can/could do all parte of the taak * 
(need only occasional supervision. 
Meets minimum local epaed and accuracy 
standards.) 

(5) Can/could do complete task quickly and 
accurately (need no supervision). 



PAST 2: 

For each job taak statement below: 

A. Indicate your CUBSEVT level of ability according to the answer key above. 

B. Estimate your PREVIOUS level of ability at the time of your EAOS according to 
the answer key above. 



"(I)- Cho'cee 
E % 
23 ii. a l 

3 1.4 2 

5 2.4 3 
9 4.2 4 



Tasks 

Operate auction apparatue, 
administer oxygen, and handle 
gee bottles following general 
aafety precautions. 

Demonstrate a basic understanding 
of anatomy and phyeiology including 
the function of body systems and 
special eonse organs. 

Perform (actual or eimulated) 
cardiopulmonary resuscitation (CPS). 

Traneport patlente with or without 
epaclal equipment. 



A B 

H Mean SD N Mean SO 

212 3,77 1.410 212 4.02 1.384 

211 4.27 .974 211 4.34 .887 

212 4.72 .678 210 4.72 .790 

213 4.32 1.064 213 4.47 1.007 
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Table D-14-2 (Continued) 



4 1.9 5. Provide emergency treatment for 213 4.18 1.053 213 4.41 .920 

co— on injuries, asphyxia, 
hem prrhago, shock, wounds, burns, 
unconac louaness , boat stroke, 
exhaustion, frost blto, 1mm rs ion 
foot, eye irritation, and hyper- 
ventilation. 

35 16.5 6. Perf on catheterization and provlda 212 3.52 1.528 212 3.78 1.509 
urinary eathater cara. 

14 6. a 7. Use basic pharmaceutical calcu- 213 3.46 1.361 213 3.82 1.255 

1st ions to prepare and dispense 
commonly usad pharnscauticais . 



12 5.6 8. Convert weights and measures to 213 3.60 1.386 213 3.82 1.262 

approximate equivalents between 
cossKmly used syetees. 

58 27.4 9. txaalne food service workers. 212 3.11 1.673 212 3.47 1.679 

20 9.4 10. Identify immunisation types, 212 3.73 1.515 212 4.14 1.402 

Methods and recording procedures. 

8 3.8 11. Assemble intravenous therapy 213 3.86 1.306 213 4.31 1.176 

equipment and regulate flow. 

24 11.3 12. Collect routine blood samples; 213 3.30 1.493 213 3.75 1.431 

perform complete blood count, 
urinalysis, and gram stain. 

32 15.0 13. Prepare minor surgical packs; 213 3.41 1.630 213 3.81 1.487 

perform sterile and sterilisation 
techniques . 

20 9.4 14. Perform ward administration 213 3.57 1.486 213 4.09 1.286 

functions (e.g., routine reports 
transcribe medical officer's 
orders, write admission nursing 
notes ) . 

34 16.0 15. Admit, transfer, and discharge 213 3.36 1.549 213 3.85 1.496 

patients . 

33 15.5 16. Perform preventive maintenance on 213 3.22 1.515 213 3.68 1.451 

ward and clinical equipment. 

6 2.8 17. Order and maintain supplies. 213 4.08 1.212 213 4.56 .897 

18. measure vital signs (e.g., 213 4.85 .631 213 4.98 .180 
temperature, respiration, 
blood pressure). 

Overall Mean: 3.80 
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Table D-14-3 

Overall Summary of HM Active Duty Questionnaire Data 



PART 1: 

1. If necessary, correct jour Service 
lumber. 

2. Does your current billot require you 
to work In your levy rating? 

Yet 246 lo a 

3. What type duty is your current 
bllletf 

See 195 Shore 87 



ARSVSR KEY: 



(1) Have never performed the teak. 

(2) Can/could do simple parte of the teak 
(need direct eupervlslon) . 

(3) Can/could do most parte of the teek 
(need general eupervlelon) . 

(4) Can/could do all perte of the teek 
(need only occeelonal eupervlelon. 
Heets minimum local epeed end accuracy 
standards . ) 

(5) Can/could do complete teak quickly end 
accurately (need no eupervlelon). 



PAST 2: 

For eech job teek statement below: 

A. Use the enewer key above to indicate your CURRENT level of ability. 

B. Use the enewer key above to estimate your EXPECTED level of ability efter 2 
yeare of nal performing these tasks. 



"(1)" Choices 

I * 

31 11.6 

4 1.4 



1.4 



17 6.0 



Tasks 

1. Operate suction apparatus, 
administer oxyaen, end handle 
gee bottles following general 
sefety precautions . 

2. Demonstrate a basic understanding 
of anatomy and physiology including 
the function of body system* end 
epeclal sense organs. 

3. Perform (actual or simulated) 
cardiopulmonary resuscitation (CPt). 

4. Transport patients with or without 
speciel equipment. 



A B 

V Mean SD H Mean SD 

284 3 . 91 1 . 390 264 3 . 26 1 . 326 

284 4.25 . 918 264 3 . 70 1.060 

283 4.77 .630 262 4.34 .878 

284 4 . 30 1 . 124 263 3 . 85 1 . 165 
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Table 0-14-3 (Continued) 



18 4.3 5. Provide emergency treatment for 
coMon injuria a, asphyxia* 
hemorrhage , ehock, wound a, burns, 
unconacloueneee, ha at etroke, 
exhauation, fro at bita, lane re ion 
foot, ay a irritation, and hyper- 
vantilation. 

58 20.6 6. Par form catheterization and provide 
urinary catheter cara. 

44 15. 5 7. Uaa basic pharmaceutical calcu- 
lations to prepare and dispenss 
commonly uaed pharmaceutical. 



29 10.2 8. 



285 4 . 15 1 . 132 266 3 . 56 1 . 168 



Convert weight a and meaeuree to 
approximate equivalent a between 
coaexmly ueed eye teas. 



93 32.9 9. Examine food eervice workers. 

38 13.5 10. Identify ismunisation typee, 

methods and recording procedure a. 

20 7.0 11. Aa a amble intravenous therapy 
equipment and regulate flow. 

42 14.7 12. Collect routine blood eamploo; 

perform complete blood count, 
urinalyeie, and gram etain. 

51 18.0 13. Prepare minor surgical packs; 

perform sterile and eterilisation 
technique a . 

57 20.2 14. Perform ward adminietration 

functione (e.g., routine reporte 
transcribe medical officer' e 
orders, writs admieeion nureing 
note*). 

«*3 29.3 15. Admit, transfer, and diecharge 
pa t lent e. 

65 23.1 16. Perform preventive maintenance on 
ward and clinical equipment. 

31 11.0 17. Order and maintain euppliee. 

4 1.4 18. measure vital eigne (e.g., 
temperature, reepiration, 
blood pre a aura) . 



281 3.52 1.549 263 3.06 1.440 

284 3.37 1.368 266 2.76 1.269 

283 3.50 1.273 265 .2.94 1.237 

2tZ Z . 22 1 . 722 21? 2 . 96 1 . 598 

2*2 3.65 1.427 263 3.00 1.299 

285 4.11 1.239 264 3.51 1.270 
285 3.44 1.451 261 2.92 1.381 

283 3.56 1.529 263 3.10 1.382 

282 3.48 1.506 259 2.93 1.320 



282 3.65 1.586 259 2.71 1.362 

281 3.21 1.530 259 2.83 1.353 

282 4.08 1.341 265 3.61 1.287 
285 4.88 .556 266 4.75 .715 
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average ability level; the "B" column, EAOS average ability level. For the 
active duty sample (table D-14-3), the "A" column refers to current (NOW) 
ability and the "B" to proficiency expected after 2 years of nonperformance 
of a task.l A Pearson Product Moment Correlation (r = .930, p< .05) com- 
puted between task means for IRR EAOS and active duly NOW (current profi- 
ciency) values indicated that the IRR members, while on active duty, per- 
formed job tasks at competency levels equivalent to those of current job 
incumbents. 

Fcr the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the ruling. This single number indicates that 
considering the HM-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean = 3.8). 

For the active duty group, means reflecting proficiency on each job 
task for HMs working/not working in their rating were computed. These are 
shown in table D-14-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-14-5 displays task proficiency means for two subgroups of the 
HM IRR respondents: (1) those who answered that they were now working ("W") 
in a field related to the Navy HM rating and (2) those who indicated that 
they were not working ("N") in a related field. Both EAOS and NOW (current) 
proficiency means are given. These means, as well as those in table D-14-4, 
were computed from choices of 2, 3, 4, or 5 from the answer key. These 
choices place proficiency along a continuum from "Need direct supervision" 
through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-14-5, values pre- 
ceded by a minus sign represent a decrease in proficiency during IRR member- 
ship: current proficiency is less than EAOS proficiency. Values with no 
signs indicate increases in proficiency. 

The table shows that HMs who now work ("W") in a field related to their 
former active duty jobs gained proficiency on 4 of the 18 job tasks. 
Although the differences are not large, this "W" group also reported less 
skill deterioration over all other rating tasks than the "N" group. Statis- 
tical tests (t tests for independent means; see Guilford and Fruchter, 1973) 
indicated that over all tasks of the rating, the proficiency of the two sub- 
groups was equivalent at EAOS (t = .4509, p< .3275). Task mean proficiency 
values, however, differed significantly [i = 3.04, p_< .0022) for current 
(NOW) proficiency. 



iThese expected-after-2-years proficiency values were not used in 
subsequent analyses, however, since it was clear that many respondents did 
not understand the question being asked. 
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Table 0-14-4 

Task Mean Values for Two Subgroups of Active Duty HMs 





Not Working ("N") 1 




Working 


( HUH \ ^ 


Task 


NOW 


EXP 




NOW 


EXP 


1 


A 917 


0 • DUU 




A "J1 9 

olc 


1 71 1 


2 


Q Q£Q 

o.yoo 


0 • HOH 




<l. ooU 


o • / ou 


3 


A QAA 


H • HUO 




A Q91 




4 


A 0 0 0 

666 


1 7/11 




A G/l 1 




5 


4.407 


3.571 




A 0£O 

^. ooy 


o . ooo 


6 




0. HOD 




^ 1 on 

4. iby 


0. OHU 


7 


3.409 


2.826 




3.850 


3.195 


8 


3.500 


9 711 




o oo o 

3.822 


0. 600 


9 


a t a n 

4.348 


j. yi/ 




4.213 


3.804 


10 


4.U43 


0 OfiQ 




4.U7U 


0 0Q7 

o. oo/ 


11 


4.071 


3.464 




4.391 


3-780 


12 


3.429 


3.154 




o 

3.933 


0. OOO 


13 


0 Q 1 0 

o.yio 


1 9flfi 
J • COKJ 




4.167 


3.553 


14 


3.840 


3.192 




4.077 


3.394 


15 


3.550 


3.043 






0 97G 

o.^/o 


16 


3.875 


3.192 




3.862 


3.357 


17 


4.423 


3.857 




4.464 


3.850 


18 


4.806 


4.700 




4.963 


4.849 




Composite Mean: 


Group W 


NOW 


4.241 








EXP 


3.673 








Group N 


NC 


4.059 










EXP 


3.483 






Overall Mean: 




NOW 


4.150 










EXP 


3.578 





In = 32 
2 n = 246 
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Table D-14-5 
Task Mean Values for Two Subgroups of IRR HMs 





Not Working ("N") 1 


Working ("W") 2 


Mean 


Difference 


Task 


NOW 


EAOS 


NOW 


EAOS 


"N" 


"W" 


1 
1 


3 843 


4 38Q 


4 479 


4 454 


-0.546 


0.025 


2 


4 111 


4 406 


4 557 


t • -J JO 


-0.295 


0.199 


3 


4 617 


4 ROR 

t • QUO 


4 860 


4 ftlO 
t • oiu 


-0.171 


0.050 


A 

4 


4 ?17 


4 5ft? 


4 676 


4 667 


-0.345 


-0.041 


r 

5 


4 111 

*t • lOl 


4 475 


4 476 


4 4f»7 


r\ O A A 

-0.344 


0.009 


r 

6 


3-912 


4.341 


4.226 


4.309 


-0.429 


-0.083 


-7 

7 


Q Cl 1 


1 QD5 

O • -7U J 


4 010 


4 117 


-0.394 


-0.107 


8 


3.641 


3.938 


4.070 


4.029 


-0.297 


0.041 


9 


4 101 


4 466 


A 10ft 


4 116 
t • oiu 


-0.365 


-0.208 


10 


H .\Jcc 


4 IQfi 
H • «3:70 


A 1 79 
H • 1 / C 


A AftA 
H» HOH 


-0.374 


-0.312 


11 


1 ft51 


4 460 


4 170 

H • J / U 


A AOA 
H • HUH 


-0.609 


-0.034 


12 


3.464 


4.011 


3.968 


4.167 


-0.547 


-0.199 


13 


3.787 


4.341 


4.154 


4.284 


-0.554 


-0.130 


14 


•J Q17 


A lAft 
H.OHO 


A 1 £ft 
H. 100 


A A7H 
H. H/U 


-0.431 


-0.302 


15 


3.862 


4.379 


4.092 


4.407 


-0.517 


-0.315 


lb 


3.558 


4.084 


4.022 


4.229 


-0.526 


-0.207 


17 


4.189 


4.634 


4.455 


4.686 


-0.445 


-0.231 


18 


4.900 


4.971 


4.954 


4.981 


-0.071 


-0.027 






Composite Mean: 


Group W 


NOW 4.320 














EOS 4.424 












Group N 


NOW 3.982 














EOS 4.385 










Overall Mean: 




NOW 4.151 







EOS 4.405 



In 
2n 



104 
107 
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TINE IN IRR 

Table D-14-6 provides a breakdown of HM personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
those IRRs who have been off active duty more than 3 years. Trends in skill 
deterioration are not apparent. 

Table D-14-6 

Mean Proficiency Values for HM IRR Respondents by Time Since EAOS 



Time (Mos.) 




No. of Cases 


Since EAOS 


Mean 


0-5 


3.70 


45 


6-11 


3.48 


16 


12-17 


3.73 


32 


18-23 


3.69 


14 


24-35 


3.76 


28 


36+ 


3.99 


73 


Overall Mean 


3.80 


208 
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COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available previ- 
ously. They also suggest directions that should be taken with respect to 
the management and utilization of the IRR resource. 

COMMENTS ON DATA BASE 

Approximately 11 percent of questionnaires returned were classified as 
"nonvalid" (table D-14-1). They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undel iverable (bad addresses). It also 
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included, but to a much smaller extent, questionnaires returned by respond- 
ents with comments such as: "No longer in IRR, returned to active duty, 
already received final discharge. Retiree recruited from another service, 
was never on active duty in the N*vy. M (All information concerning such 
cases was transmitted to the Naval Reserve Personnel Center on 26 September 
1985.) Finally, a very few questionnaires were returned by individuals who 
refused to provide information and, sone, by relatives marked, "Deceased. 11 
From the above data, it can be concluded that about 11 percent of the HM 
IRRs could not or would not br available for a mobilization call. 

Questionnaires were presumably delivered by the Postal Service to a 
number of HMs (52 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above--they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These consid- 
erations prompt a recommendation for review and validation of the HM IRR 
roster. 

Another data base issue that should be examined concerns the amount of 
time that IRR HM respondents have been away from active duty, "ihi s infor- 
mation is given in table D-14-6. 35 percent were in the IRR for more than 3 
years. Two issues emerge: (1) the need for skill upv3rading and (2) 
availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group despite their beliefs 
(table D-14-6) in their continuing ability to perform job tasks at a fairly 
high level. 

A second consideration concerns the Military Service Obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
op active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-14-5. In table D-14-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 51 percent of HM IRRs reported that they now work in a 
civilian occupation related to the HM rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-14-5 
shows, HMs who now work in a field related to their Navy rating actually 
gained proficiency on four job tasks and also reported less skill deteri- 
oration for all other HM job tasks than the M N" subgroup. Taken over all 
tasks, differences between the current (NOW) proficiency means for the two 
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subgroups were statistically significant. Also, they could not be 
attributed to initial differences between the groups at EAOS. Thus, 
civilian HM-related employment significantly affected skill deterioration. 
Those continuing to work in the HM field after EAOS report less deteri- 
oration. The tasks on which the greatest amount of skill deterioration 
occurred are easily identifiable from table D-14-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its ovm right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the impli- 
cations of skill deterioration data must be assessed against the criterion 
of acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by HM IRRs against the 
levels reported by active duty HM-3s. The task means for the active duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average HM-3 now on active duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or train- 
ing needs can be addressed. Attention is directed to the "answer key" shown 
on either table D-14-2 or D-14-3. The answer key shows that a value of "4," 
for example, represents skilled performance with only a need for occasional 
supervision. Following conventional practice, we assume that a "4" is 
reflected by any values between 3.50 and 4.4g. A "3" is interpreted simi- 
larly. Skill deterioration may be shown by lower mean values for NOW (i.e., 
current) versus EAOS proficiency. However, the change from EAOS scores may 
not be sufficient to move the IRR respondents to a lower proficiency cate- 
gory. For example, skill loss on tasks 10 to 15 occurred for the IRRs 
working in a related field. However, the losses reported resulted in the 
IRRs remaining in the "4" category (see table D-14-5). We would conclude 
that the deterioration is of no consequence insofar as signaling a need for 
retraining. 

Assessment of the need for training IRR personnel to support mobili- 
zation should proceed with the application of similar logic. Table D-14-7 
below presents the task mean values reported for current proficiency by IRR 
personnel who are not working in a field related to the HM rating and also 
for those who are working in a related field. These values are from table 
D-14-5. Task proficiency means for active duty personnel working in their 
rating (taken from table D-14-4) re also shown in table D-14-7. Inspection 
of the data shows that all values are essentially "4"s. Hence, from these 
data alone, a fair conclusion is that training of HM IRRs would not be 
required before mobilization to bring proficiency to an acceptable level. 

From our assessment, there seems to be no need for extensive retraining 
or maintenance training of HMs prior to mobilization. The average IRR HM 
should be able to perform required job tasks at an appropriate level of com- 
petency with a modicum of rcf amiliarization at mobilization. For the most 
part, this could probably be given by close, corrective supervision while 
the returnee i c performing job tasks. This conclusion pertains to all HMs 
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but is probably especially relevant to the 51 percent of IRR HMs who con- 
tinue to work in an HM-related occupation. 

Table D-14-7 

Task Mean Proficiency Values for IRR and Active Duty HMs 



IRR 



Tasks 


Not in Field 


In Field 


1 


3.8 


4.5 


c 


A 1 

4.1 


4.6 


3 


4.6 


4.9 


4 


4.2 


4.6 


5 


4.1 


4.5 


6 


3.9 


4.2 


7 


3.5 


4.0 


8 


3.6 


4.1 


9 
10 
11 


4.1 
4.0 
3.9 


4.1 
4.2 
4.4 


12 


3.5 


4.0 


13 
14 


3.8 
3.9 


4.2 
4.2 


15 
16 


3.9 
3.6 


4.1 
4.0 


17 
18 


4.2 
4.9 


4.5 
5.0 



Active Duty 
In Rating 



4.3 

4.4 

4.8 

4.5 

4.4 

4.2 

3.9 

3.8 

4.2 

4.1 

4.4 

3.9 

4.2 

4.1 

4.0 

3.9 

4.5 

5.0 



An additional factor to consider in assessing needs for trainina how- 
ever concerns time since EA0S. Thirty-five percent of the HM RRs in the 
sample were away from active duty for more thaS 3 years (see tab e D-14-6)? 

ski C udq? SftrXESS f rev V* the dat * P™1ded here may determine th 
ski n upgrade training is required because of technical changes (e q. new 
equipment, materials, procedures) in the field. 9 ' 

VALIDATION OF DATA 

Our analyses indicate that the need for traininq of HM IRRs aaainst 

ff ! IE? (i n e req t 1S H n0t h 9reat - U WCUld ™™ that r^rtr £ 
a i ^d ll- . sh ? wr V^ curre "t job incumbents) can for the most 
part oe achieved by familiarization training under direct corrective suDer- 
vislon in quite short time periods for most job tasks. Thcr are no indi- 
cations that comprehensive retraining for all rating tasks, such as L d be 

IT fnslrutt iSK'^SSS 1 W " A " School) > 1s needed At ™* 

nri iiS JL m K dules f or trainin 9 prospective HM returnees on given 
individual tasks may be required. Information not readily available to the 
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project staff is needed, however, for firm decisions about the need for 
training to bring prospective IRR returnees to an acceptable level of 
proficiency or to maintain their SKills at a defined level. We recommend 
that the information provided by this report be evaluated/validated against 
a number of other considerations. Resource sponsors would be appropriate to 
validate training needs. 

Data Review 

As noted previously, the conclusions generated by the proiect staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
bel ieved, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inhere.it in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the KM rating. 
The NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to 
be considered in the review/validation process are discussed next. 

Review Areas 

For our study, SMEs from the Navy Hospital, Orlando, identified the job 
tasks they thought would be appropriate for returning IRR HM members to 
perform. Other SMEs may not agree on the list. Resource sponsors should 
determine if these are indeed the job tasks that an IRR returnee (at mobili- 
zation) should be able to perform. Further, a companion decision is 
required concerning the acceptability of the reported level of competency. 
Since active duty personnel report that they, on the average, now perform at 
these levels, these data reflect E-4 performance. Resource sponsors should 
consider whether less proficiency would be acceptable. If so, attendant 
training requirements for IRRs with concomittant resource requirements would 
be lessened. On judging the need for training, task critical ity, in terms 
of personnel or equipment safety as it interacts with recent changes to 
material, procedures, or equipment, must also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active du*y personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
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task*. Further, while decisions must still be made concerning formal train- 
ing, either institutional or via OJT, our belief is that this type of 
training can be limited. 

Finally, Dased on (1) the IRR members' reports of their current rela- 
tively high residual levels of proficiency and (2) literature findings that 
maximum skill loss occurs after about 1 year of nonuse of skills, it appears 
that skill maintenance training for KMs is not strictly necessary. Again, 
however, this conclusion must be weighed against planned utilization of 
recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the HM IRR 
manpower pool may be smaller than believed. Approximately 10 to 11 percent 
of the pool may not be contactable by mail. An additional segment of 
unknown size may have already reenlisted and/or not be useful to the Navy 
for other reasons. A substantial percentage of HMs listed in IRR files 
could also be beyond the zone of involuntary recall. 

2. HM IKR personnel who work in civilian occupations related to their 
HM rating reported less deterioration of skills than HMs who are not simi- 
larly employed. 

3. Comprehensive retraining and maintenance training for all IRR HMs 
appear to be unnecessary to support mobilization. Familiarization training, 
at recall, consisting of supervised practice may suffice. This conclusion 
is subject to concurrence by subject matter expert HMs. 

4. HM personnel off active duty for greater than 3 years may require 
training on selected tasks to update skills despite their reported con- 
tinuing high proficiency levels. 

5. Of the 18 HM job tasks for which skill deterioration was assessed, 
indications are that none will require any concerted training for returning 
skills to an acceptable level of proficiency prior to mobilization recall. 

6. For all HM IRRs, mean values of current proficiency reported 
compare favorably with those reported by active duty personnel. This find- 
ing also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
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IRR service. Consider these individuals as first choice for mobilization 
recall. 

3. Request resource sponsors review the data of this study. Deter- 
mine if agreement can be reached that the tasks generated by schoolhouse 
SMEs adequately represent the HM-3 job. Determine that the HM-3 job is, in 
fact, acceptable as { the target performance level for training to support 
mobilization. Request resource sponsors consider the data of this study 
against factors such as changes to materials, procedures, equipment used by 
the rating, critical ity of task performance, and mobilization plans for IRR 
personnel. 

4. Consider recalling a sample of HM IRRs to assess their knowledge 
of current HM-3 job requirements. Use this information to validate the data 
and conclusions of this study. 
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INTRODUCTION 



Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigned to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); others may volun- 
tarily enlist in the IRR. IRR members, typically in a nonpay, nondrill 
status, are subject to recall to active duty if mobilization of the Armed 
Forces is ordered. A major concern of mobilization planners is that the 
skills acquired on active duty may deteriorate over time under the IRR con- 
dition of nonuse. This raises the question of the contribution that can be 
made by recalled IRR service members. To determine the extent and nature of 
skill deterioration during IRR membership, the Naval Training Systems Center 
(NAVTRASYSCEN), Code 10, conducted an assessment study. The study was per- 
formed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 
identified by OP-01. The designation "critical" was based on the criterion 
of projected personnel shortf al 1 s for mobi 1 i zat i on . The Oper at i ons 
Specialist (OS) rating was one of these 16. 

PURPOSE OF THE STUDY 



The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance pro- 
ficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 



APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A urief description is presented here. 



Mail-out questionnaires were used to obtain information. Seven senior 
enlisted OSs, assigned to the Fleet Combat Training Center, Atlantic, 
Norfolk, VA, served as subject matter experts (SME) for questionnaire 
development. Under guidance given by the project staff, the OS SMEs 
selected from various source materials a set of job tasks that, in their 
judgment, best represented the job (non-NEC specific) of an active duty 
OS-3. This level was chosen in the belief that a recalled ready reservist 
who could perform OS job tasks competently at the E-4 level would make a 
positive work contribution to a receiving unit. 
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The OS-3 job task statements were used on questionnaires mailed to IRR 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of com- 
petency was defined in terms of the amount of supervision needed to perform 
specific job tasks. 

Questionnaires mailed to IRR personnel requested information about pro- 
ficiency on each job task at the End of Active Obligated Service (EAOS) and 
at the present time (NOW). The difference between proficiency at EAOS and 
current proficiency would reflect skill deterioration during IRR membership. 

Questionnaires mailed to active duty 0S-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty OS-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. Copies of the data 
collection instruments are shown in the next section. 

As of 25 September 1984, 1,117 OSs were listed in Naval Military Per- 
sonnel Command (NAVMILPERSCOM) computer files as assigned to the IRR. Names 
and addresses were obtained from NAVMILPERSCOM through the Naval Reserve 
Personnel Center (NAVRESPERSCEN). Questionnaires were mailed on 30 October 
1984 under CNO (OP-11) cover letter to a random sample of 500 (45 percent). 
Because of a low initial return rate, a follow-up mailing (365) was made on 
29 January 1985. Questionnaire returns were accepted until 28 February 
1935. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT) , and 
within CNO (OP-01) was accomplished for authorization to survey active duty 
OS-3 personnel. An OS-3 roster, current as of 2 August 1985, was obtained 
from NAVMILPERSCOM. From a pool of 2,668, a sample of 427 0S-3s was deter- 
mined using accepted survey research methods. Questionnaires were mailed on 
18 September 1985 under CNO (OP-11) cover letter to unit/activity commanding 
officers for distribution to 0S-3s named. Returns were accepted until 31 
December 1985. Returned questionnaires were scanned to determine data 
usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of OS skill deterioration are pre- 
sented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table D-15-1 shows, for both the IRR and active duty OSs, the number of 
questionnaires mailed and number and percent of usable returns. For the IRR 
sample, the number/percent of nonvalid returns (nonvalid principally because 
of data base errors) is also shown. Percent usable returns was derived by 
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dividing the number returned (185) by the r, delivered (i.e., 500 - 31 = 
469). 

Table D-15-1 
Questionnaire Return Statistics 



Usable Returns Nonvalid 
Sample No. Mailed No. % No. % 



IRR 500 185 39 31 

Active Duty 427 290 68 



QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-15-2 for IRR personnel and in table D-15-3 for active duty person- 
nel. The tables are modified questionnaire forms. 

Background Questions 

Of 181 IRR OSs answering the question, 12 (approximately 7 percent) 
reported that they now work in a civilian occupation related to their Navy 
OS rating. Answers to the remaining two background questions for IRRs (see 
table D-15-2) ar. not reported since it was determined that the answers 
might be redundant and could not be unambiguously interpreted. Of the 
active duty respondents answering the background questions (see table D-15- 
3), 266 of 284 (94 percent) work in rating. Two hundred and seventy-two (95 
percent) are assigned shore duty. 



Ta sk Performance Data 

The data summary tables (D-15-2 and D-15-3) show the number (F) and 
percent {%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
"1.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of date (r - .563, p< .05) 
indicated significant agreement between the two rl asses of respondents. 
Thus, tasks which have not been performed by active duty OSs (to date) tend 
to be the same tasks that had not been performed by IRRs at EAOS. 



Tables D-15-2 and D-15-3 also show, for each task listed on a question- 

•naire, mean values for performance proficiency/competency, the standard 
deviation (SD) around the mean, and the number of cases (n) on which a mean 
is based. For the IRR sample, table D-15-2, the "A" column reflects current 
average ability level; the "B" column, EAOS average ability level. For the 

O D-15-5 

ERIC 329 



Technical Report 86-007 



Table D-15-2 
Overall Summary of OS IRR Questionnaire Data 

Table Overall Sumac? of OS IKt Questionnaire Data 



PAST 1: 



AISWKS KEY: 



If neces ary, correct your Service 
taker. 

Xi the work which you do VOW related 
to your levy ratin&T 

Yee 12 lo lee 

Have you done PUVI0U8 work which ia 
related to your levy rating 
aince your Expiration of Active 
Obligated Service (EAOS)T 

Yea - lo - 

Have you received training related to 
your Bevy rating since your Expiration 
of Active Obligated Service (EA08)? 
tea - lo - 



(1) liave never performed the task. 

(2) van/could do simple parts of the teak 
(need direcc euperviiion) . 

(3) Can/could do most parts of the task 
(need general supervision). 

(4) Can/could do all parts of the task 
(need only occasional supervision. 
Heats minimum local speed and accuracy 
standards . ) 

(5) Can/could do complete task quickly and 
accurately (need no supervision). 



PART 2: 

For eech job teak statement below: 

A. Indicate your CUKREVT level of ability according to the answer key above. 

D. Eatimate your PREVIOUS level of ability at the ciae of your EAOS according to 
the answer key above. 



ERLC 



"(1)" Choices 
E * 



Taake 



2 l.l 1. Start » operate* and tune radars; 

perform operational teata and 
adjustment ■ on CIC equipment. 

32 17.8 2. Operate radar Indlcator/BTDB 
consoles . 

6 3.3 3. Operate IPP equipment; process 
radar and IFF information 
through display <md dissemination. 

2 l.l 4. Distinguish radar contacts caused 
by surf*:e and air targets from 
those ceu^ed by land! weather, 
and ana lot ou* propagation. 



A B 

V Mean SD V Mean SD 

183 3.57 1.136 182 4.52 .81-. 

181 3 . 51 1 . 526 180 3 . 99 1 . 561 

181 3.66 1.262 1 81 4.36 1 . 0?6 

183 4.47 .882 184 4.82 .581 



) 4.9 5. Recognize and counter Interference/ 183 3.75 1.218 184 4.32 1.039 
j anting. 



2 1.1 6. Use and maintain publications! op 
orders , op plans, and logs. 
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Table D-15-2 (Continued) 



10 

3 1.7 



7. Carry out interior and exterior 
coamunlcatlons during: 

5 2.7 a. Iiidependent steaming. 181 4.19 1.076 183 4.62 .822 
% l 7 b Task forca steaming. 1.117 181 4.51 .847 
0 I * !. tader a^i.tedElSting. 178 3.93 1.201 180 4.42 1.035 

8. cosaUy with cosmunlcatlons 179 4,30 .994 181 4.72 .850 
security requirements. 

21 11.5 9. intarprat and disseminate Link 14 180 3.15 1.271 182 3.76 1.356 
printout data* 

9 4.9 10. mcrypt and decrypt on radiotele- 183 4.08 1.288 184 4.55 1.060 
phone circuits* 

6 3.3 11. Sncode, decode and interpret 182 4.07 1.246 183 4.56 .929 

tactical signals using the 
Tactical Signal Book. 

6 3.3 12. Bocognlso and report communication 182 3.93 1.203 183 4.43 .980 
intrusion and jasming* 

5 2.7 13. solve manuevering board problems 183 3.59 1.168 184 4.45 .979 

for course, speed, closest point 
of approach, revised closest point 
of approach, true wind, desired 
wind, change of station, and 
avoiding course. 

4 2.2 14. Maintain ships track on a nautical 183 4.28 1.107 184 4.72 .787 
chart. 

1 .5 15. Construct a cartesian coordinate 182 3.78 1.343 183 4.34 1.082 

grid plot <x-y). 

3 1.6 16. Maintain status boards. 182 4.46 .967 183 4.83 .648 

4 2.2 17. Plot formation and screen diagrama. 183 3.95 1.199 184 4.50 .923 

2 1.1 18. Maintain geographic plot on DRT/1C2 182 3.90 1.149 184 4.58 .819 

and perform "man overboard** 
procedures* 

Overall Mean: 3.97 
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Tale D-15-3 

Overall Summary of OS Active Duty Questionnaire Data 



PART X: 



AI3VER KEY: 



If necessary, cornet your Service 
lumber. 

Does your currant billot require you 
to work In your levy rating? 

Ym 266 lo 18 

What typo duty U your eurront 
billotf 

800 14 Shore 272 



(1) Havo novor performed tho took. 

(2) Con/could do olaplo parto of tho took 
(flood dlroct suporvlolon) . 

(3) Can/could do most parto of tho taok 
(nood general suporvlolon) . 

(4) Can/could do all parto of tho taok 
(nood only occasional supervision. 
Hoots minimum local spood and accuracy 
standards. ) 

(5) Can/could do complete taok quickly and 
accurately (nood no suporvlolon). 



PAST 2: 

Por each job task statement below; 

A. Use tho answer key above to Indicate your CURREBT level of ability. 

B. Use tho answer key above to estimate your IXPECTED level of ability sfter 2 
years of not performing these tasks. 



N (1) N Choices A B 

F % Tasks V Moon SD * Mean SD 

10 3.5 1. Start, operate, and tune radaro; 285 4.27 .978 276 3.29 1.035 

perform operational tests and 
adjustments on CIC equipment . 

48 16. 6 2. Operate rodar Indlcator/ITDS 285 3.91 1.566 275 3.23 1.3*0 
cesisole*. 

18 6.3 3. Operate IFF equipment; process 287 4.23 1.170 278 3.33 1.170 
radar and IFF information 
through display and dissemination. 

6 2.1 4. Distinguish radar contact! caused 288 4.73 .731 277 4.13 .972 
by surface and air targets from 
those caused by land, westher, 
and analogous propagation. 

13 4.6 5. tecognlze and counter interference/ 285 4.01 1.060 277 3.23 1.150 



4 X.4 6. Use and maintain publications, op 287 4.21 .897 278 3.39 1.075 
orders i op plans, and logo. 
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Table D-15-3 (Continued) 



11 

15 
17 



3. a 

5.3 
(.0 

2.1 



54 18.8 



14 4.9 



2.8 



12 4.2 



4 

11 
9 



1.4 



2.8 



17 (.0 



1.4 
3.8 
3.1 



Carry out interior and exterior 
cossminlcatlons during: 

a. Independent steaming. 

b. Tat* force steaming . 

e. tadar at fitted piloting. 



8. Comply with cosmunlcatlons 
tecurity requirement! . 

9. Interpret and disseminate Link 14 
printout data. 

10. Encrypt and decrypt on radiotele- 
phone circuits* 

11. Encode, decode and interpret 
tactical signals using the 
tactical Signal Booh. 

12. tecognise and report communication 
intrusion and jamming. 

13. Solve manueverlng board problems 
for course, sp eed, closest point 
of approach, revised closest point 
of approach, true wind, desired 
wind, change of station, and 
avoiding coursS. 

14. maintain ships track on a nautical 
chart - 

15. Construct a cartesian coordinate 
grid plot (x-y). 

It. Maintain status boards. 

17. Plot formation and screen diagrams. 

18. Maintain geographic plot on DRT/SC2 
and perform "man overboard** 
procedures. 



286 4.58 .906 280 3.79 1.101 

281 4.36 1.040 274 3.54 1.145 

281 4.34 1.064 274 3.55 1.170 

285 4.62 .795 277 3.75 1.087 



287 3.47 1.495 276 2.76 1.245 



288 4 . 79 1 . 046 280 3.66 1 . 210 



287 4,58 .865 280 3.76 1.058 



286 4.18 1.052 275 3.36 1.107 



288 4.43 .857 279 3.18 1.050 



288 4.71 .830 277 4.13 1.072 

285 2.24 1.123 276 3.47 1.254 

288 4.82 .628 279 4.31 .939 

288 4.49 .963 279 3.75 1.198 

288 4.52 .944 278 3.56 1.128 
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active duty sample (table D-15-3), the "A" column refers to current (NOW) 
ability and the "B" to proficiency expected after 2 years of nonperformance 
of a task.l. A Pearson Product Moment Correlation (r = .627, p < .05) 
computed between task means for IRR EAOS and active duty NOW (current pro- 
ficiency) values indicated that the IRR members, while on active duty, 
performed job tasks at competency levels equivalent to those of current job 
incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the OS-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean - 4.0). 

For the active duty group, means reflecting proficiency on each job 
task for OSs working/not working in their rating were computed. These are 
shown in table D-15-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table D-15-5 displays task proficiency means for two subgroups of the 
OS IRR respondents: (1) those who answered that they were now ("W") working 
in a field related to the Navy OS rating and (2) those who indicated that 
they were not working ("N") in a related field. Both EAOS and NOW (current) 
proficiency means are given. These means, as well as those in table D-15-4, 
were computed from choices of 2, 3, 4, or 5 from the answer key. These 
choices place proficiency along a continuum from "Need direct supervision" 
through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-15-5, values pre- 
ceded by a minus sign represent a decrease in proficiency during IRR member- 
ship: current proficiency is less than EAOS proficiency. Values with no 
signs would indicate increases in proficiency. 

The table shows that all OSs, regardless of current civilian employ- 
ment, lost proficiency on all job tasks. Although the differences are not 
large, the subgroup (n=12) who reported that they now worked in a field 
related to the OS rating lost less skill overall than the subgroup not 
currently working in an OS-related civilian job. Statistical tests (t tests 
for independent means; see Guilford and Fruchter, 1973) indicated that over 
all tasks of the rating, the proficiency of the two subgroups differed 
significantly at EAOS (t = 4.32, p<.0005), and task mean proficiency values 
also differed significantly (I = 1.96, p< .0289) on current (NOW) 
proficiency. 



iThese expected-af ter-2-years proficiency values were not used in 
subsequent analyses, however since it was clear that many respondents did 
not understand the question t ng asked. 
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Table 0-15-4 

Task Mean Values for Two Subgroups of Active Duty OSs 



Not Working ("N") 1 Working ("W") 2 
NOW EXP NOW EXP 



3.429 


3.154 




4.447 


3.375 


3.417 


3.000 




4.564 


3.696 


3.385 


2.750 




4.514 


3.518 


4.188 


3.857 




4.851 


4.213 


3.615 


3.417 




4.193 


3.344 


3.813 


3.467 




4.298 


3.460 


4.091 


3.727 




4.753 


3.902 


4.100 


3.700 




4.578 


3.679 


4.000 


3.727 




4.597 


3.734 


4.250 


3.688 




4.729 


3.813 


3.200 


3.000 




4.087 


3.165 


4.UUU 


j. oUU 




Hi / 13 


"? 829 


4.214 


3.643 




4.723 


3.844 


3.692 


3.154 




4.363 


3.488 


3.647 


3.Ub3 






"K ??7 

J • CC 1 


4.462 


4.091 




4.836 


4.244 


4.154 


3.308 




4.472 


3.682 


4.529 


4.000 




4.893 


4.378 


4.308 


3.636 




4.656 


3.892 


3.786 


3.000 




4.700 


3.673 


Composite Mean: 


Group W 


NOW 


4.576 






EXP 


3.708 






Group N 


NOW 


3.914 








EXP 


3.459 




Overall Mean: 




NOW 


4.245 








EXP 


3.583 
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Table D-15-5 
Task Mean Values for Two Subgroups of IRR OSs 





Not Working ("N") 1 


Working ("W") 2 


Mean 


Difference 


l ask 


NOW 

nun 




iiun 


pad*; 


"N" 


"W" 


i 


3.654 


4.548 


4.182 


4.583 


-0.894 


-0.401 


2 


4.119 


4.635 


3.900 


4.600 


-0.516 


-0.700 


3 


3.806 


4.441 


4.167 


4.833 


-0.635 


-0.666 


4 


4.494 


4.845 


4.917 


5.000 


-0.351 


-0.083 


5 


3.936 


4.460 


4.167 


4.750 


-0.524 


-0.583 


6 


4.072 


4.554 


4.583 


5.000 


-0.482 


-0.417 


7A 


4.319 


4.720 


4.250 


4.750 


-0.401 


-0.500 


7B 


4.082 


4.555 


4.083 


4.750 


-0.473 


-0.667 


7C 


4.132 


4.603 


4.167 


4.833 


-0.471 


-0.666 


& 


4.360 


4.774 


4.500 


4.917 


-0.414 


-0.417 


9 


3.435 


4.107 


3.636 


4.364 


-0.672 


-0.728 


10 


4.306 


4.716 


4.455 


4.909 


-0.410 


-0.454 


11 


4.234 


4.650 


4.333 


5.000 


-0.416 


-0.667 


12 


4.012 


4.521 


4.083 


4.833 


-0.509 


-0.750 


13 


3.689 


4.521 


3.833 


4.750 


-0.832 


-0.917 


14 


4.370 


4.783 


4.917 


5.000 


-0.413 


-0.083 


15 


3.881 


4.429 


4.583 


4.917 


-0.548 


-0.334 


16 


4.540 


4.880 


4.667 


5.000 


-0.340 


-0.333 


17 


4.075 


4.548 


4.000 


4.833 


-0.473 


-0.833 


18 


3.969 


4.595 


4.000 


4.917 


-0.626 


-0.917 



Composite Mean: Group W NOW 4.271 

EOS 4.827 

Group N NOW 4.074 

EOS 4.594 

Overall Mean: NOW 4.173 

EOS 4.711 



In = 169 
2 n = 12 
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TIME IN IRR 



Table D-15-6 provides a breakdown of OS personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
those IRRs who have been off active duty more than 3 years. Trends in skill 
deterioration are not apparent. 

Table D-15-6 

Mean Proficiency Values for OS IRR Respondents by Time Since EAOS 
Time (Mos.) 

Since EAOS Mean No. of Cases 



0-5 4.16 32 

6-11 4.00 20 

12-17 4.06 45 

18-23 4.28 16 

24-35 3.95 12 

36+ 3.62 44 

Overall Mean 3.97 169 



COMMENTS AND OBSERVATIONS 

Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about skill deterioration and retraining 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available previ- 
ously. They also suggest directions that should be taken with respect to 
the management and utilization of the IRR resource. 



COMMENTS ON DATA BASE 



Approximately 6 percent of questionnaires returned were classified as 
"nonvulid" (table D-15-1). They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undel iverable (bad addresses). It also 
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included, but to a much smaller extent, questionnaires returned by respond- 
ents with comments such as: "No longer in IRR, returned to active duty, 
already received final discharge. Retiree recruited from another service, 
was never on active duty in the Navy." (All information concerning such 
cases was transmitted to the Naval Reserve Personnel Center on 26 September 
1985.) Finally, a very few questionnaires were returned by individuals who 
refused to provide information and, some, by relatives marked, "Deceased." 
From the above data, it can be concluded that only about 6 percent of the OS 
IRRs could not or would not be available for a mobilization call. 

Questionnaires were presumably delivered by the Postal Service to a 
number of OSs (61 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above—they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These consid- 
erations prompt a recommendation for review and validation of the OS IRR 
roster. 

Another data base issue that should be examined concerns the amount of 
time that IRR OS respondents have been away from active duty. This infor- 
mation is given in table D-15-6. Twenty-six percent were in the IRR for 
more than 3 years. Two issues emerge: (1) the need for skill upgrading and 
(2) availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group despite their beliefs 
(table D-15-6) in their continuing ability to perform job tasks at a fairly 
high level. 

A second consideration concerns the military service obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

In the OS case, data base problems are far less apparent than for the 
other ratings studied. A 6 percent "bad address" rate, the lowest of all 
ratings assessed, is probably tolerable. Also, the finding that 74 percent 
of the rating has been away from active duty for less than 3 years suggests 
that OS skills will be at a higher level than those of other ratings. It 
also suggests that a proportionately higher number of OSs, compared to many 
other ratings will be available for recall. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-15-5. In table D-15-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 
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Approximately 7 percent of OS IRRs reported that they now work in a 
civilian occupation related to the OS rating and the effects of this worK 
experience on skill deterioration will be considered next. As table D-15-5 
shows, all OSs regardless of civilian employment lost skill on all job 
tasks. Those who now work in a field related to their Navy rating, however, 
reported less skill deterioration overall than the subgroup not working in a 
related field. Taken over all tasks, differences between the current (NOW) 
proficiency means for the two subgroups were statistically significant. 
Thus, it appears that civilian OS-related employment affects OS skill 
deterioration. Those continuing to work in the field after EAOS report less 
deterioration. However, since the two subgroups also differed at EAOS, this 
conclusi on cannot be f i rmly stated si nee there are al ternate expl anati ons 
possible. The tasks on which the greatest amount of skill deterioration 
occurred are easily identifiable from table D-15-5. 

TRAINING NEEDS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to mobilization. Thus, the implications of 
skill deterioration data must be assessed against the criterion of 
acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by OS IRRs against the 
levels reported by active duty 0S-3s. The task means for the active duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average OS-3 now on active duty. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or train- 
ing needs can be addressed. Attention is directed to the "answer key" shown 
on either table D-15-2 or D-15-3. The answer key shows that a value of "4, 11 
for example, represents skilled performance with only a need for occasional 
supervision. Following conventional practice, we assume that a "4" is 
reflected by any values between 3.50 and 4.49. A "3" is interpreted simi- 
larly. Skill deterioration may be shown by lower mean values for NOW (i.e., 
current) versus EAOS proficiency. However, the change from EAOS scores may 
not be sufficient to move the IRR respondents to a lower proficiency cate- 
gory. Skill loss on task 3, for example, occurred for all OS IRRs, but the 
losses reported resulted in the IRRs remaining in the "4" category (see 
table D-15-5). We would conclude that the deterioration is of no conse- 
quence insofar as signaling a need for retraining. 

Assessment of the need for training IRR personnel to support mobili- 
zation should proceed with the application of s:milar logic. Table D-15-7 
below presents the task mean values reported for current proficiency by IRR 
personnel who are not working in a field related to the OS rating and also 
for those who are working in a related field. These values are from table 
D-15-5. Task proficiency means for active duty personnel working in their 
rating (taken from table D- 15-4) are also shown in table D-15-7. Inspection 
of the data shows that all values except for task 9 are essentially M 4 M s. 
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Hence, from these data alone, a fair conclusion is that comprehensive 
training of OS IRRs would not be required before mobilization to bring 
proficiency to an acceptable level. 

Table D-15-7 

Task Mean Proficiency Values for IRR and Active Duty OSs 

IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


1 


3.7 


4.2 


4.4 


2 


4.1 


3.9 


4.6 


3 


3.8 


4.2 


4.5 


4 


4.5 


4.9 


4.9 


5 


3.9 


4.2 


4.2 


6 


4.1 


4.6 


4.3 


7a 


4.3 


4.3 


4.8 


7b 


4.1 


4.1 


4.6 


7c 


4.1 


4.2 


4.6 


8 


4.4 


4.5 


4.7 


9 


3.4* 


3.6 


4.1 


10 


4.3 


4.5 


4.7 


11 


4.2 


4.3 


4.7 


12 


4.0 


4.1 


4.4 


13 


3.7 


3.8 


4.6 


14 


4.4 


4.9 


4.8 


15 


3.9 


4.6 


4.5 


16 


4.5 


4.7 


4.9 


17 


4.1 


4.0 


4.7 


18 


4.0 


4.0 


7.7 


♦Probable training needs. 







From our assessment, there seems to be no need for extensive retraining 
or maintenance training prior tj mobilization. The average IRR OS should be 
able to perform required job tasks at an appropriate level of competency 
with a modicum of ref ami 1 iarization at mobilization. For the most part, 
this could probably be given by close, corrective supervision while the 
returnee is performing job tasks. This conclusion of minimal training needs 
pertains to all OSs but is probably especially relevant to those who con- 
tinue to work in an OS-related occupation. Although the number of indi- 
viduals in this subgroup was small, the finding mirrors that of other 
ratings. 

An additional factor to consider in assessing needs for training 
concerns time since EAOS. Twenty-six percent of the OS IRRs in the sample 
were away from active duty for more than 3 years (see table 0-15*6). 
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Subject matter experts who review the data provided here may determine that 
skill upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 



VALIDATION OF DATA 

Our analyses indicate that the need for training of OS IRRs against 
mobilization requirements is not great. It would appear that required pro- 
ficiency (i.e., the level shown by current job incumbents) can for the most 
part be arhieved by familiarization training under direct corrective super- 
vision in quite short time periods for most job tasks. There are no indi- 
cations that comprehensive retraining for all rating tasks, such as would be 
provided in a formal school setting (e.g., "A" School), is needed. At worst 
case, instructional modules for training prospective OS returnees on given 
individual tasks (e.g., task 9) may be required. Information not readily 
available to the project staff is needed, however, for firm decisions about 
the need for training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the information provided by this report be evaluated/ 
validated against a number of other considerations. Resource sponsors would 
be appropriate to validate training needs. 



Data Review 



As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the OS rating. 
The NAVTRASYSCEN, if requested, could assist SMEs in this effort. Areas to 
be considered in the review/validation process are discussed next. 



Review Areas 



For our study, SMEs from the Fleet Training Center, Norfolk, VA, iden- 
tified the job tasks they thought would be appropriate for returning IRR OS 
members to perform. Other SMEs may not agree on the list. Resource spon- 
sors should determine if these are indeed the job tasks that an IRR returnee 
(at mobilization) should be able to perform. Further, a companion decision 
is required concerning the acceptability of the reported level of compe- 
tency. Since active duty personnel report that they, on the average, now 
perform at these levels, the data reflect E-4 criterion performance. 
Resource sponsors should consider whether less proficiency would be 
acceptable. If so, attendant training requirements for IRRs with concomit- 
tant resource requirements would be lessened. On judging the need for 
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training, task criticality, in terms of personnel or equipment safety as it 
interacts with recent changes to material, procedures, or equipment, must 
also be considered. 

An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals rt ill serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some especially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It is our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Further, while decisions must still be made concerning formal train- 
ing, either institutional or via OJT, our belief is that this type of 
training can be limited. 

Finally, based on (1) the IRR members' reports of their current rela- 
tively high residual levels of proficiency and (2) literature findings that 
maximum skill loss occurs after about 1 ye*r of nonuse of skills, it appears 
that skill maintenance training for OSs is not strictly necessary. Again, 
however, this conclusion must be weighed against planned utilization of 
recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the OS IRR 
manpower pool may be somewhat smaller than believed. Approximately 6 
percent of the pool may not be contactable by mail. An additional segment 
of unknown size may have already reen listed and/or not be useful to the Navy 
for other reasons. A substantial percentage of OSs listed in IRR files 
could also be beyond the zone of involuntary recall. 

2. OS IRR personnel who work in civilian occupations related to their 
JS rating reported less deterioration of skills overall than those not simi- 
larly employed. 

3. Comprehensive retraining and maintenance training for IRR OSs 
appear to be unnecessary to support mobilization. With the exception of one 
task, familiarization training, at recall, consisting of supervised practice 
may suffice. This conclusion is subject to concurrence by subject matter 
expert OSs. 

4. OS personnel off active duty for greater than 3 years may require 
training on selected tasks to update skills despite their reported con- 
tinuing high proficiency levels. 
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5- Of the 18 OS job tasks for which skill deterioration was assessed, 
indications are that only 1, dealing with Link 14, will require training 
emphasis prior to mobilization recall. 

6. For all OS IRRs, mean values of current proficiency reported 
compare favorably with those reported by active duty personnel. This 
finding also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
at all times. " v .e whatever other steps are necessary and available to 
assure continuou ^dating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Consider these individuals as first choice for mobilization 
recall . 

3. Request resource sponsors review the data of this study. Deter 
mine if agreement can be reached that the tasks generated by schoolhou„*. 
SMEs adequately represent the 0S-3 job. Determine that the 0S-3 job is, in 
fact, acceptable as the target performance level for training to support 
mobilization. Request resource s, ^sors consider the data of th!s study 
against factors such as changes to materials, procedures, equipment used by 
the rating, critical ity of task performance, and mobilization plans for IRR 
personnel . 

4. Consider recalling a sample of OS IRRs to assess their knowledge 
of current 0S-3 job requirements. Use this information to validate the data 
and conclusions of this study. 
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INTRODUCTION 

Following a first-tour of active duty, Naval personnel who do not elect 
other reserve options are assigrjd to the Individual Ready Reserve (IRR) to 
complete a specified Military Service Obligation (MSO); other personnel may 
voluntarilyu enlist in the IRR. IRR members, typically in a nonpay, non- 
drill status, are subject to recall to active duty if mobilization of the 
Armed Forces is ordered. A major concern of mobilization planners is that 
the skills acquired on active duty may deteriorate over time under the IRR 
condition of nonuse. This raises the question of the contribution that can 
be made by recalled IRR service members. To determine the extent and nature 
of skill deterioration during IRR membership, the Naval Training Systems 
Center (NAVTRASYSCEN), Code 10, conducted an assessment study. The study 
was performed at the request of the Chief of Naval Operations (0P-01R1). 

This study assessed skill deterioration for 16 critical Navy ratings 

identified by OP-01. The designation "critical" was based on the criterion 

of projected personnel shortfalls for mobilization. The Sonar Technician 
(Surface) (STG) rating was one of these 16. 

PURPOSE OF THE STUDY 

The purpose of the study was to assess skill deterioration during IRR 
membership and determine needs for training IRR personnel to restore, 
upgrade, or maintain their skills at minimum proficiency levels to support 
mobilization. Implicit in the tasking was the additional requirement to 
define minimum, or acceptable, proficiency. 

In a general sense, acceptable proficiency refers to the ability of a 
recalled ready reservist to make an effective contribution to a receiving 
unit's mission. In a more specific sense, it refers to ability to perform a 
defined set of job tasks at a defined level of competency. Performance pro- 
ficiency information was essential to establish a baseline around which 
obtained skill deterioration information could be assessed and to define the 
terminal performance goals that any proposed training regimen should attempt 
to achieve. 

APPROACH 

Complete details of the technical approach to the study are presented 
in the main body of this report. A brief descn, uion is presented here. 

Mail-out questionnaires were used to obtain information. Six senior 
enlisted STGs, assigned to the Fleet Anti -Submarine Warfare Training Center, 
Pacific (San Diego, CA), served as subject matter experts (SME) for 
questionnaire development. Under guidance given by the project staff, the 
STG SMEs selected from various source materials a set of job tasks that, in 
their judgment, best represented the job (non-NEC specific) of an active 
duty STG-3. This level was chosen in the belief that a recalled ready 
reservist who could perform STG job tasks competently at the H-4 level would 
make a positive work contribution to a receiving unit. 
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The STG-3 job task statements were used ci questionnaires mailed to IRK 
and active duty personnel. Information sought concerned tasks performed and 
the level of competency attached to the performance of each. Level of 
competency was defined in terms of the amount of supervision needed to 
perform specific job tasks. 

Questionnaires mailed to IRR personnel requested information about pro- 
fic ancy on each job task at the End of Active Obligated Service (EAOS) and 
at the present time (NOW). The difference between proficiency at EAOS and 
current proficiency would reflect skill deterioration during IRR membership. 

Questionnaires mailed to active duty STG-3s requested information about 
current proficiency on job tasks and proficiency expected after 2 years of 
nonperformance of the job tasks. The current proficiency estimates were 
needed to define criterion job performance for an active duty STG-3. The 
data reflecting what is currently done on the job would define an acceptable 
level of performance. These data could be used as a baseline for judging 
amount and consequences of IRR skill deterioration. They also set an upper 
limH on the proficiency levels that training must achieve to maintain at or 
restore skills to acceptable levels. Copies of these data collection 
instruments are shown in the next section. 

As of 25 September 1984, 341 STGs were listed in Naval Military Person- 
nel Command (NAVMILPERSCOM) computer files as assigned to the IRR. Names 
and addresses were obtained from NAVMILPERSCOM through the Naval Reserve 
Personnel Center (NAVRESPERSCEN) . Questionnaires were mailed under CNO (0P- 
11) cover letter on 22 October 1984 to the entire population of 341. 
Because of a low initial return rate, a follow-up mailing (246) was made on 
29 January 1985. Questionnaire returns were accepted until 28 February 
1985. 

Coordination with Commander in Chief, U.S. Atlantic Fleet 
(CINCLANTFLT), Commander in Chief, U.S. Pacific Fleet (CINCPACFLT), and 
within CNO (0P-01) was accomplished for authorization to survey active duty 
STG-3 personnel. An STG-3 roster, current as of 2 August 1985, was obtained 
from HAVMILPERSCOM. From a pool of 1,531, a sample of 400 STG-3s was deter- 
mined using accepted survey research methods. Questionnaires were mailed on 
18 September 1985 under CNO (0P-11) cover letter to unit/activity commanding 
officers for distribution to STG-3s named. Returns were accepted until 31 
December 1985. Returned questionnaires were scanned to determine data 
usability, and data were entered into computer files. Subsequently, 
summaries of the information of interest to the study were prepared. 

RESULTS 

Results pertinent to the assessment of STG skill deterioration are pre- 
sented in this section. 

QUESTIONNAIRE RETURN STATISTICS 

Table D-16-1 shows, for both the IRR and active duty STGs, the number 
of questionnaires mailed and number and percent of usable returns. For the 
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IRR sample, the number/percent of nonval id returns (nonval id principally 
because of data base errors) is also shown. Percent usable returns was 
derived by dividing the number returned (124) by the number delivered (i.e., 
341 - 36 = 305). 

Table D-16-1 
Questionnaire Return Statistics 



Sample 


No. Mailed 


Usable 
No. 


Returns 

% 


Nonval id 
No. % 


IRR 


341 


124 


41 


36 11 


Active Duty 


400 


268 


67 





QUESTIONNAIRE DATA SUMMARIES 

Summaries of data obtained from the questionnaires are presented in 
table D-16-2 for IRR personnel and in table D-16-3 for active duty person- 
nel. The tables are modified questionnaire forms. 

Background Questions 

Of 121 IRR STGs answering the question, 22 (approximately 18 percent) 
reported that they now work in a civilian occupation related to their Navy 
STG rating. Answers to the remaining two background questions for IRRs (see 
table D-16-2) are not reported since it was determined that the answers 
might be redundant and could not be unambiguously interpreted. Of the 
active duty respondents answering the background questions (see table D-16- 
3), 251 of 264 (95.1 percent) work in rating. Two hundred and sixty (98 
percent) are assigned shore duty. 

Task Performance Data 

The data summary tables (D-16-2 and D-16-3) show the number (F) and 
percent (%) of respondents reporting that they had never performed 
particular job tasks (i.e., they responded to the task description with a 
■I.") For IRRs, these data refer to the "at EAOS" answers and for active 
duty to the current (NOW) level of ability. A rank-order correlation (see 
Siegel, 1956) computed between the two sets of data (r = .804, p< .05) 
indicated significant agreement between the two classes of respondents. 
Thus, tasks which have not been performed by active duty STGs (to date) are 
the same tasks that had not been performed by IRRs at EAOS. 

Tables D-16-2 and D-16-3 also show, for each task listed on a question- 
naire, mean values for performance proficiency/competency, the standard 
deviation (SD) around the mean, and the number of cases (n) on which a mean 
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Table D-16-2 
Overall Summary of STG IRR Questionnaire Data 



PART It 



AISVCR KEY: 



1. If nicMMrx, comet jour Service 
•umber. 

2* Is the work which you do BOW reletod 
to your navy ratlngf 

Yea Vo 99 

3* Hovo you done FUVIOUt work which io 
roio tod to your Bevy rot ins 
eince your Expiration of Active 
Obligated Service (EA08)? 

Too - lo - 

4 Have you received training rolotod to 
your Wavy eating since your Expiration 
of Activo Obligated Service (EAOS)T 
Yes - Vo _ - 



(1) Have never performed the took. 

(2) Can/could do simple parte of the teak 
(need direct eupervlelon) . 

(3) Can/could do moat parte of the team 
(need general supervision) . 

(4) can/could do all parte of the teak 
(need only occasional supervision. 
Heats minimum local apeed and accuracy 
standards. ) 

(5) Can/could do complete teak quickly and 
accurately (need no supervision) . 



FAIT 2: 



For «ach job teak statement below: 

A* Indicate your CUEMST level of ability according to the answer key above* 

B. totimate your P1KVI0U8 level of ability at the time of your 1A0S according to 
the answer key above. 



M (D" Choices A B 

t * Tasks V Mean SO I Mean 80 

B 6.5 1* Interpret peeeive/active aonar 122 3.36 1.240 123 4.2', 1.165 
recorder tracea. 

6 4.9 2* Operate aonar sensors; perform 122 3*65 1*23* 123 i.43 1,064 

operational testa and nuke external 
adjustment a on equipment. 

14 11.3 3* Identify characteristics, functions, 123 2.98 1*177 124 3.71 1.324 
and effects of controlled jamming 
and evasive devices on aonar 
operations. 

3 2.5 4. Determine range predictions. 121 3*43 1.132 122 4.39 .949 

7 5.6 5. Prepare and Interpret aonar 122 3.21 1.192 124 4.13 1.111 

message. 
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Table D-16-2 (Continued) 



2.4 6. Itport, record, detect, and 123 3.74 1.172 124 4.51 .888 

classify contacts; determine: 
target beer ins end range, range 
rate, target angle, target aspect 
and Doppler, true and relative 



$ 


4.5 


7. 


11 


8.9 


8. 


3 


2.4 


9. 


S 


4.1 


10. 


14 


12.9 


11. 



notion, and target course. 



functions. 



123 3 . 55 1 . 288 124 4 . 12 1 .200 



Operate torpedo countemeasure 123 3.63 1.405 124 4.20 1.307 
equi p m en t. 

Operate -;athytnermograph. 123 4. 25 1. 121 124 4 . 73 . 827 

Operate tape recording equipment, 122 4.21 1.100 123 4.58 .992 

Operate underwater battery fire 122 2.98 1.298 124 3.41 1.390 
control system. 

7.3 12. Complete supply forms; complete 122 2.93 1.169 124 3.74 1.245 
maintenance data forms for: 
a) completed maintenance actions 
(mat), b) deferred maintenance 
actions, and c) work requests. 

.980 
.911 



5 


4.0 


13. 


Operate underwater telephone. 


123 


4.10 


1.217 


124 


4.59 


4 


3.2 


14. 


Operate Fathometer. 


123 


4.25 


1.221 


124 


4.65 


6 


4.8 


15. 


inspect t clean, and lubricate 

electromechanical/electronic 

equipment. 


122 


3.90 


1.269 


124 


4.40 

i 


7 


5.9 


16. 


Perform weapons handling evolutions. 


118 


3.65 


1.277 


119 


4.28 



17. What class ship(s) were you on? 

Overall Mean: 3.62 
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Table D-16-3 

Overall Summary of ST6 Active Duty Questionnaire Data 



PAR 1: 



AMSVO KEY: 



1. If necessary, comet your Service 
■later. 

2* Done your current billot roquiro you 
.to work in your lavy rating? 

ton 231 So 13 

3. What typo duty it your currant 
billotf 

8aa £_ thorn 2*0 



(1) Havo never performed tho tank. 

(2) Can/could do slap la parts of tha taak 
(nood diraet supervision) • 

(3) Can/could do nost pacta of tho taak 
(nnnd lanaral supanriaion) , 

(4) Can/could do all pacta of tho taak 
(nnnd only occasional supervision. 
Hosts nininun local apand and accuracy 
standards,) 

(5) Can/could do complete taak quickly and 
accurately (nood no supervision). 



PaK 2: 

for aack job taak ststasjsnt below: 

a. use tho answer kay above to indicata your CUM1ST lovol of ability. 

B. Uaa tho answer kay abova to estimate your DEPICTED lovol of ability aftar 2 
years of no£ performing thnaa tasks. 



-d)" Choicaa 
E * 

40 15.0 



25 9.3 

70 29.3 

17 a. 4 

37 14.0 



Tasks 

Xntorrrat passiva/actlva sonar 
recorder traces . 

Operate sonar sensors; perform 
operational teata and sake external 
adjustments on equipment. 



Mean SO 



Mean SD 



244 3.29 1.393 256 2.70 1.037 
26S 3.72 1.264 260 2.96 1.083 



Identify characteristics, functions, 266 2.63 1.312 253 2.17 .902 
and affects of controlled jamming 
and svaaive devices on sonar 
operatlona. 



Detemina range predictions. 

°*nyaro mcA interpret sonar 
message. 



266 4.05 1.141 256 3.02 1.122 
264 3.52 1 . 331 252 2.65 1 . 012 



3.30 
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Table D-16-3 (Continued) 



18 


6.7 


6. fttport, record, da tact, and 
classify contacts; dtttniM: 
target bearing «nd range, rang* 
rati, target angle, target aspect 
and Doppler, true and relative 
motion, and target couree. 


267 


3.83 


1.141 


258 


2.88 


.979 


31 


11.7 


7. lecognlse major equipment mal- 
functions. 


266 


3.69 


1.336 


259 


3,12 


1.198 


52 


It. 4 


•• Operate tocpado countcmsature 
equipment. 


268 


3.40 


1.466 


238 


9 ac 




19 


7.1 


9. Oparata pathytnemograph. 


268 


4.41 


1.165 


259 


3.77 


1.213 


37 


14*0 


10* Oparata tapa recording equipment. 


263 


3*79 


1.430 


256 


^3.37 


1.351 


$3 


31*2 


11. Oparata underwater battery fire 
control system. 


266 


2.77 


1.470 


233 


2.32 


1.190 


34 


20.1 


12. Complete supply forms; complete 
maintenance data forma for: 
a> eomplatad maintenance actions 
OUT), b) dafarrad maintenance 
actions, and c) work requests. 


268 


2.97 


1.303 


256 


2.41 


1.063 


41 


13.3 


13. Oparata underwater telephone. 


268 


3.69 


1.432 


258 


3.09 


1.207 


34 


12.7 


14* Oparata Fathometer. 


267 


4.01 


1.390 


257 


3.41 


1.320 


34 


12.7 


15* Xnspact, clean* and lubricate 
electromechanical/electronic 
equipment. 


268 


3*66 


1.387 


260 


3.27 


1.314 


44 


It. 7 


16. Parform weapons handling avolutlons. 


263 


3.48 


1.370 


255 


2.92 


1.208 



17. What class shlp(s) vara you onf 
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is based. For the IRR sample, table D-16-2, the "A" column reflects current 
average ability level; the "B" column, EAOS average ability level. For the 
active duty sample (table D-16-3), the "A" column refers to current (NOW) 
ability and the "B M to proficiency expected after 2 years of nonperformance 
of a task. 1 A Pearson Product Moment Correlation (r « .913, p< .05) com- 
puted between task means for IRR EAOS and active duly NOW (current profi- 
ciency) values indicated that the IRR members, while on active duty, 
performed job tasks at competency levels equivalent to those of current job 
incumbents. 

For the IRR group, an overall grand mean for current proficiency was 
computed over all tasks for the rating. This single number indicates that 
considering the ST6-3 job in its entirety (as reflected by the tasks used) 
the average IRR member feels that he could now perform tasks of the rating 
at a level where only occasional supervision would be needed (mean - 3.6). 

For the active duty group, means reflecting proficiency on each job 
task for STGs working/not working in their rating were computed. These are 
shown in table D-16-4. Again, the expected-after-2-years data are provided 
for information only. 

SKILL DETERIORATION 

Table 0*16-5 displays task proficiency means for two subgroups of the 
STG IRR respondents: (1) those who answered that they were now working 
("W") in a fie*d related to the Navy STG rating and (2) those who indicated 
that they were not working ( 11 N M ) in a related field. Both EAOS and NOW 
(current) proficiency means are given. These means, as well as those in 
table D-16-4, were computed from choices of 2, 3, 4, or 5 from the answer 
key. These choices place proficiency along a continuum from "Need direct 
supervision" through "Need no supervision." 

As mentioned earlier, skill deterioration is reflected by differences 
between EAOS proficiency and NOW proficiency. In table D-16-5, values pre- 
ceded by a minus sign represent a decrease in proficiency during IRR member- 
ship: current proficiency is less than EAOS proficiency. Values with no 
signs would have indicated increases in proficiency. 

The table shows that STGs who now work ("N") in a field related to 
their former active duty jobs, compared to the group not currently working 
in an STG-related civilian job, reported less deterioration in proficiency 
on 6 of 16 job tasks, and more deterioration on 9 others, Statistical tests 
(t tests for independent means; see Guilford and Fruchter, 1973) indicated 
that over all tasks of the rating, the task mean proficiency values for two 
subgroups were equivalent, both at EAOS (t = .948, p < .1753) and on current 
(NOW) proficiency (t = 267, £<.396). 



iThese expected-after-2-years proficiency values were not used in 
subsequent analyses, however, since it was clear that many respondents did 
not understand the question being asked. 
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Task Mean Values for Two Subgroups of Active Duty STGs 



Not Working ("N") A Working ("W") 

Task NOW EXP NOW EXP 



1 


3.000 


2.833 




3.726 


2.909 


2 


4.000 


3.200 




3.987 


3.142 


3 


3.200 


2.800 




3.317 


2.593 


4 


4.100 


3.143 




4.271 


3.185 


5 


3.571 


2.833 




3.940 


2.818 


6 


3.556 


2.500 




4.046 


3.030 


7 




3 333 




4 040 


3 322 


8 


3.833 


4.000 




3.971 


3.223 


9 


4.750 


4.143 




4.660 


3.936 


10 


4.444 


3.875 




4.231 


3.692 


11 


3.500 


4.000 




3.584 


2.838 


12 


2.571 


2.833 




3.483 


2.739 


13 


3.833 


2.500 




4.183 


3.356 


14 


4.286 


3.714 




4.446 


3.705 


15 


3.625 


3.167 




4.058 


3.549 


16 


4.000 


3.429 




3.981 


3.233 




Composite Mean: 


Group W 


NOW 


3.995 










EXP 


3.204 








Group N 


NOW 


3.758 










EXP 


3.269 






Overall Mean: 




NOW 


3.877 










EXP 


3.237 





in = 13 
2n = 251 




9 

ERIC 



D-16-ii 353 



Technical Report 86-007 

Table D-16-5 
TasK Mean Values for Two Subgroups of IrtR STGs 





Not Working ("N") 1 


Working ("W") 2 


Mean 


Difference 


Tack 


NOW 


EA0S 


NOW 


EA0S 


II Mil 

n 


HUH 

n 


l 


3.670 


A A A C 

4.495 


3.318 


a /ion 

4.429 


-0.825 


-l.lll 


2 


3.796 


4.5/0 


3.905 


4. 750 


-0.777 


-0 845 


3 


3.291 


4.046 


3.200 


A 1 

4. 136 


-0.755 


-0.936 


4 


*i ceo 

3.558 


A Af\C 

4.495 


o 4 cn 
J. 450 


A OOO 


-0.9J7 


-0.883 


5 


3.467 


4.298 


3.143 


4.364 


-0.831 


-1.221 


6 


3.865 


4.586 


3.857 


4.619 


-0.721 


-0.762 


7 


3.703 


4.287 


3.955 


4.524 


-0.584 


-0.569 


8 


3.966 


4.467 


4.000 


4.700 


-0.501 


-0.700 


9 


4.453 


4.818 


4.333 


4.857 


-0.365 


-0.524 


10 


4.387 


4.747 


4.409 


4.636 


-0.360 


-0.227 


11 


3.195 


3.884 


3.857 


4.381 


-0.689 


-0.524 


12 


3.116 


3.935 


3.364 


4.095 


-0.819 


-0.731 


13 


4.340 


4.742 


4.250 


4.714 


-0.402 


-0.464 


14 


4.411 


4.776 


4.400 


4.762 


-0.365 


-0.362 


15 


4.033 


4.500 


4.619 


4.905 


-0.467 


-0.286 


16 


3.988 


4.500 


3.857 


4.381 


-0.512 


-0.524 



Composite Mean: Group W NOW 3.870 

EOS 4.537 

Group N NOW 3.827 

EOS 4.447 

Overall Mean: NOW 3.849 

EOS 4.492 



In = 99 

2n = 22 
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TIHE IN IRR 



Table D-16-6 provides a breakdown of STG personnel by time spent in the 
IRR prior to mail out of the questionnaires. The table also shows mean 
values assigned for proficiency for 6-month intervals of IRR time, and for 
those IRRs who have been off active duty more than 3 years. Trends in skill 
deterioration over time are not apparent. 



Table D-16-6 

Mean Proficiency Values for STG IRR Respondents by Time Since EAOS 



Time (Mos.) 
Since EAOS 


Mean 


No. of Cases 


0-5 


3.95 


23 


6-11 


3.91 


12 


12-17 


3.42 


14 


18-23 


3.69 


19 


24-35 


3.66 


13 


36+ 


3.31 


31 


Overal 1 


3.62 


112 



COMMENTS AND OBSERVATIONS 



Comments and observations on the data are offered here. As warranted, 
interpretations are made and discussed. These interpretations provide the 
basis for certain conclusions about ski 11 deterioration and retraini ng 
needs. Our conclusions are based on best available data. However, they are 
subject to validation. The low questionnaire return rates coupled with the 
uncertain quality of the IRR data base (discussed below) require cautious 
inferences and limit generalizations. Nevertheless, the results do provide 
much useful information about the IRR that has not been available previ- 
ously. They also suggest directions that should be taken with respect to 
the management and utilization of the IRR resource. 



COMMENTS ON DATA BASE 




Approximately 11 percent of questionnaires returned were classified as 
"nonvalid" (table D-16-1). They reflect probable errors in the IRR data 
base. The nonvalid category included, most prominently, questionnaires 
returned by the Postal Service as undeliverable (bad addresses). It also 
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included, but to a much smaller extent, questionnaires returned by respond- 
ents with comments such as: "No longer in IRR, returned to active duty, 
already received final discharge. Retiree recruited from another service, 
was never on active duty in the Navy." (All information concerning such 
cases was transmitted to the Naval Reserve Personnel Center on 26 September 
1935.) Finally, a very few questionnaires were returned by individuals who 
refused to provide information and, some, by relatives marked, "Deceased. 11 
From the above data, it can be concluded that about 11 percent of the STG 
IRRs could not or would not be available for a mobilization call. 

Questionnaires were presumably delivered by the Postal Service to a 
number of STGs (59 percent) from whom no information was received. It is 
likely that many did not respond for reasons such as those cited above--they 
felt the questionnaire was not applicable. A further group, of unknown 
size, then would also be unavailable for mobilization because they are not 
in the viable IRR manpower pool as is currently believed. These consid- 
erations prompt a recommendation for review and validation of the STG IRR 
roster. 

Another data base issue that should be examined concerns the amount of 
time that IRR STG respondents have been away from active duty. This infor- 
mation is given in table D-16-6. Twenty-eight percent were in the IRR for 
more than 3 years. Two issues emerge: (1) the need for skill upgrading and 
(2) availability of IRR members. Upgrade training because of new equipment, 
procedures, or material may be required for this group despite their beliefs 
(table D-16-6) in their continuing ability to perform job tasks at a fairly 
high level. 

A second consideration concerns the Military Service Obligation (MSO). 
Those who are liable for a 6- or 8-year MSO (depending on when they entered 
on active duty) may be involuntarily recalled. Those who are beyond the MSO 
may only be recalled under existing agreements. If these agreements do not 
exist, still fewer individuals may be actually recallable for mobilization. 
The size of the available IRR manpower pool may be overestimated. Again, 
the recommendation is made that this data base be reviewed and validated if 
this is not already occurring. 

SKILL DETERIORATION 

Information directly pertinent to the question of skill deterioration 
was presented in table D-16-5. In table D-16-5, differences between mean 
values at EAOS and NOW (current proficiency) are shown. Values preceded by 
a minus sign represent skill deterioration potentially attributable to time 
spent in the IRR. 

Approximately 18 percent of STG IRRs reported that they now work in a 
civilian occupation related to the STG rating and the effects of this work 
experience on skill deterioration will be considered next. As table D-16-5 
shows, STGs who now work in a field related to their Navy rating reported 
less skill deterioration for seven of the STG job tasks and greater skill 
deterioration for nine others than the subgroup not working in a related 
field. Taken over all tasks, there does not appear to be a significant 
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difference between the current (NOW) proficiency means for the two sub- 
groups. Thus, civilian STG-related employment did not significantly affect 
skill deterioration. The tasks on which the greatest amount of skill 
deterioration occurred are easily identifiable from table D-16-5. 

TRAINING NEEOS 

While skill deterioration information is of interest in its own right, 
the more important concern of this study is with determining the need for 
training IRR personnel prior to a mobilization recall. Thus, the impli- 
cations of skill deterioration data must be assessed against the criterion 
of acceptable level of proficiency. This can be done most directly by 
comparing the current proficiency levels reported by STG IRRs against the 
levels reported by active duty STG-3s. The task means for the active duty 
sample can be taken as E-4 criterion performance since they reflect the 
level of proficiency claimed by the average S1G-3 now on active duty. These 
data set an upper limit on "acceptable" proficiency. Lower levels may also 
be considered acceptable. 

The meaning of specific numerical values reported for task means must 
be clearly understood before conclusions about skill deterioration or 
training needs can be addressed. Attention is directed to the "answer key" 
shown on either table D-1G-2 or D-16-3. The answer key shows that a value 
of "4," for example, represents skilled performance with only a need for 
occasional supervision. Following conventional practice, we assume that a 
"4" is reflected by any values between 3.50 and 4.49. A "3" is interpreted 
similarly. Skill deterioration may be shown by lower mean values for NOW 
(i.e., current) versus EAOS proficiency. However, the change from EAOS 
scores may not be sufficient to move the IRR respondents to a lower profi- 
ciency category. For example, skill loss on tasks 1 to 6 occurred for the 
IRRs working in a related field. However, the losses reported on tasks 2, 
4, and 6 resulted in the IRRs remaining in the "4" category (see table D-16- 
5). We would conclude that for these tasks the deterioration is of no 
consequence insofar as signaling a need tor retraining. On several tasics, 
including 1, 3, and 5, the skill deterioration did move the respondents to 
the "3" category. Whether this should be a cause for concern requires 
further consideration. 

Table D-16-7 below presents the task mean values reported for current 
proficiency by IRR personnel who are not working in a field related to the 
STG rating and also for those who are working in a related field. These 
values are from table D-16-5. Task proficiency means for active duty per- 
sonnel working in their rating (taken from table 0-16-4) are also shown in 
table D-16-7. Inspection of the data shows that most values are essentially 
"4"s. In some cases where cirrent skill level has deteriorated to a lower 
category of proficiency, the absolute skill value is still comparable to 
that of the active duty respondents. Even in the worst cases, the scores 
for IRR members indicate the capability to do most parts of the task with 
only general supervision. Hence, from these data alone, a fair conclusion 
is that training of STG IRRs would not be required before mobilization to 
bring proficiency to an acceptable level. 
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Table D-16-7 

Task Mean Proficiency Velue: for IRR and Active Duty STGs 



IRR Active Duty 



Tasks 


Not in Field 


In Field 


In Rating 


1 


3.7 


3.3* 


3.7 


2 


3.8 


3.9 


4.0 


3 


3.3 


3.2 


3.3 


4 


3.6 


3.5 


4.3 


5 


3.5 


3.1* 


3.9 


6 


3.9 


3.9 


4.0 


7 


3.7 


4.0 


4.0 


8 


4.0 


4.0 


4.0 


9 


4.5 


4.3 


4.7 


10 


4.4 


4.4 


4.2 


12 


3.2* 


3.9 


3.6 


13 


3.1* 


3.4 


3.5 


14 


4.3 


4.3 


4.2 


15 


4.4 


4.4 


4.4 


16 


4.0 


4.6 


4.1 


17 


4.0 


3.9 


4.0 


♦Probable t 


ning needs. 







From our assessment, there seems to be no need for extensive retraining 
or maintenance training of STGs prior to mobilization. The average IRR STG 
should be able to perform required job tasks at an appropriate level of com- 
petency with a modicum of ref ami liar ization at mobilization. For the most 
part, this could probably be given by close, corrective supervision while 
the returnee is performing job tasks. 

An additional factor to consider in assessing needs for traininq, how- 
ever, concerns time since EAOS. Twenty-eight percent of the STG IRRs in the 
sample were away from active duty for more than 3 years (see table D-16-6). 
Subject matter experts who review the data provided here may determine that 
skill upgrade training is required because of technical changes (e.g., new 
equipment, materials, procedures) in the field. 

VALIDATION OF DATA 

Our analyses indicate that the need for training of STG IRRs against 
mobilization requirements is not great. It would appear that required 
proficiency (i.e., the level shown by current job incumbents) can for thp 
most part be achieved by familiarization training under direct corrective 
supervision in quite short time periods for most job tasks. There are no 
indications that comprehensive retraining for all rating tasks, such as 
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would be provided in a formal school setting (e.g., "A" School), is needed. 
At worst case, instructional modules for training prospective STG returnees 
on given individual tasks may be required. Information not readily 
available to the project staff is needed, however, for firm decisions about 
the need for training to bring prospective IRR returnees to an acceptable 
level of proficiency or to maintain their skills at a defined level. We 
recommend that the information provided by this report be evaluated/ 
validated against a number of other considerations. Resource sponsors would 
be appropriate to validate training needs. 



Data Review 



As noted previously, the conclusions generated by the project staff are 
considered tentative and subject to verification. Generalizations from the 
data have also been limited because of the small numbers of questionnaires 
returned and because of suspected IRR data base inadequacies. It is 
believed, however, that much useful information can be gleaned from the 
descriptive summaries provided. Most of this information has not previously 
been available because of the many difficulties inherent in conducting skill 
deterioration research and restrictions on methods that can be used because 
of practical considerations. Maximum exploitation of the information that 
is now available is in order. A complete and accurate assessment of the 
meaning and action implications of the data should be made by individuals 
who are thoroughly knowledgeable of technical requirements of the STG 
rating. The NAVTRASYSCEN, if requested, could assist SMEs in this effort. 
Areas to be considered in the review/validation process are discussed next. 

Review Areas 



For our study, SMEs from the ASW Training Center (Pacific) identified 
the job tasks they thought would be appropriate for returning IRR STG 
members to perform. Other SMEs may not agree on the list. Resource spon- 
sors should ^'termine if these are indeed the job tasks that an IRR returnee 
(at mobilization) should be able to perform. Further, a companion decision 
is required concerning the acceptability of the reported level of compe- 
tency. Since active duty personnel report that they, on the average, now 
perform at these levels, these data reflect E-4 criterion performance. 
Resource sponsors should consider whether less proficiency would be 
acceptable. If so, attendant training requirements for IRRs with concomit- 
tant resource requirements would be lessenea. On judging the need for 
training, task criticality, in terms of personnel or equipment safety as it 
interacts with recent changes to material, procedures, or equipment, must 
also be considered. 



An additional decision factor concerns plans for utilization of IRR 
personnel at mobilization. If these individuals will serve as casualty 
replacements, then a fairly high level of proficiency at recall is 
desirable. Training, as determined by the study data and by the resource 
sponsor, should occur prior to recall. If, however, IRR members will 
replace current active duty personnel in less demanding assignments, then 
time would be available for receiving units or some ^specially chartered 
intermediate activity to provide needed training. Likely, the bulk of this 
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training could be done either on the job or in on-the-job type conditions 
where IRR returnees could demonstrate their ability to perform job tasks 
under close, corrective supervision. It ;s our belief, based on available 
data that desired proficiency would be achieved relatively quickly on most 
tasks. Further, while decisions must still be made concerning formal train- 
ing, either institutional or via OJT, our belief is that this type of 
training can be limited. 

Finally, based on (1) the IRR members' reports of their current rela- 
tively high residual levels of proficiency and (2) literature findings that 
maximum skill loss occurs after about 1 year of nonuse of skills, it appears 
that skill maintenance training for STGs is not strictly necessary. Again, 
however, this conclusion must be weighed against planned utilization of 
recalled IRR members. For example, a casualty replacement scenario would 
make maintenance training more desirable than other scenarios. 

CONCLUSIONS 

1. Mobilization planners should be aware that the size of the STG IRR 
manpower pool may be smaller than believed. Approximately 10 to 11 percent 
of the pool may not be contactable by mail. An additional segment of 
unknown size may have already reenlisted and/or not De useful to the Navy 
for other reasons. A substantial percentage of STGs listed in IRR files 
could also be beyond the zone of involuntary recall. 

2. IRR personnel who work in civilian occupations related to their 
Navy rating reported less/more deterioration of skills (depending on the 
task) than STGs who are not similarly employed. A larger sample size is 
needed for firmer conclusions about the relationship between skill loss and 
civilian employment. 

3. Comprehensive retraining and maintenance training for all IRR STGs 
may be unnecessary prior to suDport mobilization. Familiarization training, 
at recall, consisting of supervised practice may suffice. This conclusion 
is subject to concurrence by subject matter expert STGs. 

4. STG personnel off active duty for greater than 3 years may require 
training on selected tasks to update skills. 

5. Of the 16 STG job tasks for which skill deterioration was 
assessed, indications are that none will require any concerted training for 
returning skills to an acceptable level of proficiency prior to mobilization 
recall . 

6. For all STG IRRs, mean values of current proficiency reported 
compare favorably with those reported by active duty personnel. This 
finding also suggests minimal needs for retraining. 

RECOMMENDATIONS 

1. Review, update, and validate the IRR data base content to assure 
that accurate assessments of the size of the IRR manpower pool are available 
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at all times. Take whatever other steps are necessary and available to 
assure continuous updating of the data base. 

2. Amend existing procedures where possible to obtain information 
from IRR members concerning civilian employment. At the very least, obtain 
this information from those eligible for or receiving bonuses for continued 
IRR service. Establish proficiency levels for a greater number of IRR STG- 
3s currently working in a related occupation. 

3. Request resource sponsors review the data of this study. Deter- 
mine if agreement can be reached that the tasks generated by schoolhouse 
SMEs adequately represent the STG-3 job. Determine that the STG-3 job is, 
in fact, acceptable as the target performance level for training to support 
mobilization. Request resource sponsors consider the data of this study 
against factors such as changes to materials, procedures, equipment used by 
the rating, criticality of task performance, and mobilization plans for IRR 
personnel . 

4. Consider recalling a sample of STG IRRs to assess their knowledge 
of current STG-3 job requirements. Use this information to validate the 
data and conclusions of this study. 
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